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Preface 

This  research  was  accomplished  for  several  reasons. 
First,  of  course,  it  was  done  as  part  of  the  requirements 
for  a degree  in  Systems  Management  from  the  Air  Force 
Institute  of  Technology-  Second,  being  in  the  position 
of  ratee  and  future  rater,  I wanted  to  become  aware  of 
the  opinions  and  facts  involved  in  the  evaluation  process. 
Third,  it  was  done  with  the  intent  of  providing  insight 
into  the  junior  officer  perceptions  of  the  new  OER  system. 
Fourth,  based  on  these  insights,  to  identify  any  conflicts 
which  may  exist  between  the  perceptions  and  reality. 

In  my  opinion  the  research  was  done  in  an  extremely 
objective  manner  in  order  to  maintain  the  validity  of  the 
results.  Great  care  was  taken  to  collect,  analyze  and 
present  the  data  in  an  unbiased  fashion.  I have  seen  a 
lot  of  statistics  in  regard  to  the  OER  presented  in  such 
a manner  as  to  misrepresent  the  facts.  I have  made 
every  effort  to  present  my  statistics  so  as  to  represent 
the  data  collected. 

I would  like  to  express  my  appreciation  to  Dr. 
Michael  Stahl  who  suggested  the  topic  and  provided  help 
and  encouragement.  Also,  I would  like  to  thank  iuy  wife, 
Cindy,  whose  typing,  help  and  encouragement,  made  this 
effort  possible. 


Steven  Keyserling 
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Abstract 

The  purpose  of  this  study  is  to  investigate  the  impact 
of  the  current  OER  system  on  the  junior  officers  of  the 
United  States  Air  Force.  A survey  of  trie  attitudes, 
opinions,  and  perceptions  of  537  Air  University  Students 
indicates  that  the  new  CER  system  has  solved  old  problems 
and,  at  the  same  time,  created  new  problems.  The  ignoring 
or  denying  of  problems  in  a system  will  not  cause  them  to 
cease  to  exist.  The  problems  caused  by  the  imperfections 


of  the  new  system  are  minor  in  magnitude  at  this  time  and 
not  cause  for  alarm  or  concern.  However,  if  the  imperfec- 
tions continue  to  be  denied  or  ignored,  misconceptions  and 
rumors  will  increase  the  magnitude  of  the  problem  out  of 
proper  perspective.  The  new  problems  can  lead  to  demotiva- 
tion and  dissatisfaction,  which  could  decrease  the  Air  Force 
mission  effectiveness.  Recommendations  include  scaling, 
defining  and  establishing  criterion  for  the  evaluation  of 
potential  and  methods  to  prevent  gaming  of  the  system.  The 
author  recommends  that  the  appropriate,  agencies  evaluate  the 
conclusions  and  recommendations.  If  valid,  the  author 
suggests  corrective  action  be  initiated  immediately. 
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CHAPTER  I 
INTRODUCTION 

Ths  new  Officer  Effectiveness  Report  (OER)  System  was 
implemented  in  the  United  States  Air  Force  (US  ) in 
November  1974.  The  new  system  had  been  under  development' 
for  several  years  *-o  correct  deficiencies  in  the  old  system. 
Tn&-  new  sy^  tem  was  designed  specifically  to  eliminate  the 
old  ief * ciencies  and  at  the  same  time,  provide  a better 
me.-.ru'  ’ / evaluate  the  performance  of  an  officer  and  to 
measure  his  promotion  potential.  Special  emphasis  was 
placed  on  the  ability  to  identify  the  truly  outstanding 
officer,  which  was  a difficult  task  under  the  old  OER 
system  (Ref  3:1) . 

One  of  the  major  reasons  for  the  adoption  of  a new 
system  was  to  correct  for  the  "inflation"  which  had  taken 
place  in  the  old  system.  Under  the  old  system,  as  late 
as  1961,  less  than  five  percent  of  all  USAF  officers 
received  a top-block  rating.  By  1971,  nearly  ninety 
percent  of  all  USAF  officers  received  a top-block  rating. 
Seventy-five  percent  of  the  officers  had  five  consecutive 
highest  block  (nines)  ratings.  Not  only  was  it  becoming 
more  difficult  for  promotion  boards  to  identify  those 
officers  with  the  most  potential,  but  the  process  of 
selecting  the  best  qualified  officer  for  more  challenging 
assignments  was  not  helped  by  the  inflated  OER's  (Ref  4:1). 
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Not  only  were  the  officers  concerned  that  the  "system" 
was  not  working,  but  also  the  leaders  of  the  USAF.  The 
leadership  had  attempted  to  rectify  the  inflation 
by  passing  down  directives  to  spread-out  the  ratings. 

However,  the  directives  lacked  the  teeth  to  force  compliance. 
Lower-echelon  leaders  felt  that  if  they  rated  an  officer 
anywhere  below  a top-block  rating,  without  assurance  that 
others  would  be  doing  the  same,  they  would  be  jeopardizing 
that  officer’s  promotion  and  career  possibilities.  As  long 
as  compliance  was  on  a voluntary  basis,  no  one  wanted  to 
risk  the  consequences.  The  inflation  continued  and  was 
self-perpetuating.  Headquaters  Air  Force  recognised  that 
without  directives  controlling  the  distribution  of  ratings, 
the  inflation  trend  could  not  be  stopped  (Ref  10:54-55). 

The  key  to  the  new  system  was  to  "control"  the  distri- 
bution of  ratings  by  placing  limits  on  how  many  officers  . 
could  receive  ratings  in  the  top,  second  and  other  blocks. 
Under  the  new  system  only  twenty-two  percent  of  the  officers 
being  evaluated  can  receive  a top-block  rating.  No  more  than 
fifty  percent  can  receive  the  top  and  second  block  rating. 

The  remaining  fifty  percent  must  receive  a third-block  or 
lower  rating.  In  essence,  this  boils  down  to  2255  receiving 
a tcp-block  rating,  28 % receiving  a second  block  rating  and 
505  receiving  a third-block  rating  (there  are  six  blocks  in 
total) . (See  Appendix  A) . These  distributions  apply  only 
to  those  officers  being  evaluated  and  is  done  for  each  grade. 
The  new  OER  affects  all  the  grades  of  lieutenant  through 
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colonel  (Ref  4:22). 

The  majority  of  officers  agreed  that  a new  system  was 
needed  due  to  the  inflation  of  ratings  and  the  lack  of 
controls  to  stop  the  inflation  (Ref  3:3).  However,  the 
acceptance  of  the  new  system  is  varied  and  unknown.  The 
main  source  of  contention  is  the  control  on  the  distribution 
of  ratings.  Many  officers  are  not  sure  of  the  impact  these 
controls  are  having  on  their  promotion,  assignment  and 
career  possibilities.  The  author,  in  informal  discussion 
with  the  members  of  class  GSM-76D  at  the  Air  Force  Institute 
of  Technology  (AFIT) , found  them  to  believe  the  new  system 
to  be  more  harmful  than  beneficial.  The  effect  the  new 
system  is  having  on  AF  officers  is,  as  yet,  not  fully  known. 

With  the  incorporation  of  the  controls  into  the  new 
system,  the  new  OER  system  can  be  described  as  a zero-sum 
rating  system.  A zero-sum  system  is  one  in  which  any  change 
adds  to  zero.  For  example,  in  a card  game  with  two  men,  when 
one  looses  five  dollars,  the  other  wins  five  dollars. 
Similarly,  in  an  organization  of  10  men  where  5 are  rated 
"below-average"  and  2 of  the  "below-average"  men  leave,  then 
1 of  the  men  who  was  rated  "above  average"  previously,  must 


now  be  rated  "below1 average" . The  use  of  zero-sum  systems 
in  industrial  experiences  has  not  been  encouraging. 
Experience  has  shown  that  a comparative  ranking  of  personnel 


has  been  a deflating  experience  of  70$  to  80$  of  all  those 
people  ranked  and  would  have  a negative  effect  on  their 
self-esteem.  Not  only  does  the  zerc-sum  system  have  adverse 
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effects  on  those  being  ranked,  but  also  on  those  doing  the 
ranking.  The  supervisor  finds  it  hard  to  motivate  his 
personnel  when  he  has  to  tell  half  his  personnel  their 
performance  is  just  average  (Ref  6) . 

The  zero-sum  game  rating  system  does  not  necessarily 
reflect  reality,  in  that,  with  the  increased  performance 
or  effectiveness  of  one  officer,  there  follows  a decrease 
in  performance  or  effectiveness  of  another  officer.  The 
reverse  may  be  true,  however.  The  zero-sum  game  rating 
system  does  let  an  individual  know  how  he  stands  in 
relationship  to  another  individual.  Private  companies 
have  found  that  the  zero-sum  game  system  has  brought 
about  some  unexpected  and  unpleasant  results.  Some  of 
.the  negative  results  have  been  increased  anxiety,  work 
slow-down  and  morale  suffering  substantially  (Ref  6:152). 

There  exists  much  literature  on  evaluation  and 
appraisal  systems  in  general.  The  author  was  unable  to 
find  any  material  dealing  specifically  with  a zero-sum 
game  rating  system  other  than  that  provided  by  Dalton 
and  Thompson.  The  supplementary  bibliography  is  provided 
by  the  author  for  those  individuals  desiring  additional 
information  on  rating  systems  in  general. 
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Problem  Statement 

Under  the  old  OER  system,  it  was  possible  for  every 
officer  to  receive  a top-block  rating.  This  is  no  longer 
possible  under  the  new  OER  system  due  to  the  forced  distri- 
bution of  ratings.  The  perceptions  that  a junior  officer 
holds  as  to  what  influences  the  rating  he  receives,  have  many 
effects  on  the  officer.  Due  to  the  fact  that  not  everyone 
can  receive  a top-block  rating,  the  perceptions  thac  junior 
officers  (0-3  and  0-2)  hold  as  to  what  factors  influence 
their  ratings  becomes  very  important.  These  perceptions 
have  an  impact  on  the  attitudes,  performance  and  career 
intentions  of  the  USAF  junior  officer  corps. 

If  the  perceptions  that  the  junior  officers  have  of 
the  new  OER  system  are  the  same  as  ones  they  held  under 
the  old  OER,  then  the  USAF  may  have  solved  inflation.  If, 
however,  the  old  perceptions  are  different  from  the  new 
perceptions,  the  USAF  may  have  curer  inflation,  but  with 
what  other  results?  Have  old  problems  been  cured  at  the 
expense  of  creating  new  problems?  By  comparing  the  old  and 
new  perceptions,  any  changes  can  be  observed.  In  addition, 
by  looking  at  some  of  the  unique  features  of  the  new  OER 
system,  some  other  results  of  the  new  system  can  be  observed 
or  detected. 
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Objectives 

The  objective  of  this  study  is  to  compare,  and  assess 
the  differences  of  perceptions  relating  to  the  new  and  old 
OER  system.  In  addition,  to  identify  and  analyze  some  of 
the  perceptions  associated  with  the  peculiarities  of  the 
new  OER  system. 
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i Scope  and  Limitations 

There  are  several  limitations  which  are  imposed  on  this 
study.  Due  to  the  large  number  of  junior  officers  in  the 
USAF,  only  a sample  was  selected  as  a data  base  to  reflect 
the  perceptions  of  the  overall  group  of  junior  officers. 
Secondly,  in  order  to  have  surveyed  as  large  a group  as 
possible  in  a timely  fashion,  a questionnaire  was  the 
primary  tool  for  data  gathering. 

As  there  could  be  an  unlimited  number  of  factors  which 
influence  the  OER  rating  system,  a list  was  compiled  con- 
taining those  factors  believed  to  be  the  most  influential. 
Thus,  the  main  source  of  input  from  the  questionnaire  was 
derived  from  a list  of  factors  selected  by  the  author  as 
having  the  most  influence  on  the  OER. 
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t Assumptions 

1.  It  was  assumed  that  the  list  of  factors  involved  contained 
the  most  important  factors  influencing  the  ratings  under  the 
OER  system. 

2.  It  was  assumed  that  the  responses  given  by  the  involved 
individuals  were  truthful  and  reflective  of.  their  perceptions. 
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Organization  of  Study 

Research  methodology  is  presented  in  Chapter  II. 

Included  are  the  rationales  behind  the  use  of  the  question- 
naire and  the  choice  of  the  sample  group  used.  Included  are 
the  procedures  and  techniques  used  to  extract  the  data 
obtained. 

In  order  to  present  the  data  in  a meaningful  format. 
Chapter  III  will  include  a discussion  of  each  factor  con- 
sidered to  be  influential  in  the  OER  rating  system. 

Responses  to  most  questions  will  be  broken  into  5 categories. 
Chapter  III  will  also  include  the  responses  to  those  questions 
relating  only  to  the  new  OER  system. 

Conclusions  and  recommendations  are  presented  in 
Chapter  IV.  The  conclusions  reached  about  perceptions  of 
the  OER  system  are  based  on  an  analysis  of  the  data  obtained. 
The  conclusions  lead  to  the  recommendations  which  are  aimed 
at  improving  weaknesses  identified  by  this  study.  The  intent 
is  to  design  a more  effective  OER  rating  system. 
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Chapter  II 
METHODOLOGY 

The  survey  procedures  and  techniques  used  in  this  study 
were  based  on  the  constraints  and  limitations  described  in 
Chapter  I.  While  a long-range  and  very  broad  study  would 
have  been  preferred  to  research  the  impact  of  the  OER  system 
this  was  not  possible.  Such  a study  would  have  provided  a 
detailed  explanation  as  to  the  effects  the  new  OER  is  having 
on  the  officer  corps.  Many  factors,  principally,  time  and 
manpower,  prevented  such  an  effort.  The  conception,  formu- 
lation, approach  and  reporting  was  compressed  into  a five 
month  period,  thus,  preventing  an  Air  Force  wide  study  over 
any  extended  period  of  time. 

While  a long  range  study  to  investigate  the  effects  of 
the  actual  OER  system  was  not  possible,  this  study  will 
research  the  opinions  and  perceptions  of  officers  with  the 
new  OER  system  having  been  implemented  for  almost  two 
years.  The  new  OER  system  appears  to  have  reached  a fairly 
staJale  existence  in  the  manner  in  which  it  is  being  imple- 
mented. Thus,  while  the  system  is  stable  the  perceptions 
and  opinions  being  formed  are  likely  to  be  static,  also. 

The  data  upon  which  this  study  is  based  is  comprised  of  the 
opinions  and  perceptions  of  those  USAF  officers  who  were 
in  residence  at  Squadron  Officers'  School  in  July  and 
August  of  1976. 


fe- 


lt) 


y^Nril  5*-  «i'w  ' ->v»f'i«j^“ 


GSM/SM/76D-32 


Survey  Group 


The  survey  group  consisted  of  only  those  officers 
attending  SOS,  thus,  this  research  is  based  only  on  junior 
officers  in  the  grade  of  captain  and  lieutenant.  The 
survey  group  is  a result  of  a screening  and  selection  pro- 
cedure which  leaves  them  unrepresentative  of  the  general 
junior  officer  population.  As  a result,  this  group  is  not 
a random  sample  of  junior  officers  in  the  Air  Force.  One 
factor  which  makes  this  group  unrepresentative  of  junior 
officers,  in  general,  is  the  disproportionate  distribution 
of  OER  ratings  (Reference  Appendix  C for  further  details) . 
Therefore,  the  data  presented  here  is  not  from  a random  and 
truly  representative  group.  It  is  the  responsibility  of  each 
individual  reader  to  weigh  this  bias  when  attempting  to  apply 
any  interpretations  to  a less  restrictive  sample  of  Air  Force 
junior  officers.  A method  used  to  correct  some  of  this  bias 
is  presented  later  in  this  chapter. 

If  the  selection  procedures  are  coupled  with  the  pro- 
fessional military  institution  goal  of  developing  the  future 
leaders  of  the  Air  Force;  the  officers  in  this  study  should 
be  the  future  supervisors  and  comninders.  The  opinions  and 
perceptions  these  officers  hold  today  will  influence  the 
course  of  the  OER  system  tomorrow.  In  addition,  the 
officers  ir  this  study  have  been  selected  and  rewarded  by 
the  system.  While  the  amount  and  type  of  reward  may  be 
open  for  debate,  the  system  has  selected  these  officers  as 


11 


S'lWtV  * < ’ 


GSM/SM/7  6D-  3 2 


being  the  most  qualified  of  their  contemporaries.  Thus,  this 
survey  group  consists  of  the  more  secure  junior  officers  in 
the  Air  Force. 

If  this  secure  feeling  leads  to  any  bias,  it  will  be 
one  of  a conservative  nature.  Having  been  selected  by  the 
system,  the  survey  group  should  perceive  less  of  a threat 
from  the  new  OER  system.  Due  to  this  conservative  nature, 
any  misgivings  or  apprehensions  expressed  by  the  survey 
group  would  probably  be  felt  more  strongly  by  a less  select 
group.  It  is  left  to  the  reader  to  use  this  rationale 
when  any  attempt  is  made  to  extrapolate  the  findings  of  this 
study  beyond  the  survey  group. 

To  assist  in  determining  the  similarity  of  this  survey 
group  co  any  other,  recognition  of  the  conservative  aspect 
should  be  kept  in  mind.  To  aid  the  reader  in  determining 
any  similarity  between  the  survey  group  and  any  other  group 
for  which  a comparison  may  be  made.  Appendix  C contains  a 
limited  breakout  of  some  of  the  demographics  of  this  survey 
group.  Additional  demographic  data  can  be  found  in 
Appendix  C. 

Questionnaire  Description 

A self-administered  questionnaire  was  used  in  this 
research  effort  (See  Appendix  B) . The  use  of  such  a 
questionnaire  allows  the  respondent  to  work  at  his  own  pace 
with  minimal  distraction.  A questionnaire  also  assures  a 
standardization  of  stimulus  and  permits  the  respondent  to 
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f react  in  an  unbiased  atmosphere.  The  questionnaire  makes 

it  possible  to  survey  a large  group  in  a limited  amount  of 
time.  This  methodology  made  it  possible  to  survey  a much 
larger  group  than  the  use  of  a structured  interview  or 
open-ended  questioning  would  have  allowed. 

The  questionnaire  consisted  of  four  sections;  demo- 
graphics, factor  comparison,  factor  preference,  and  new 
OER  preceptions.  The  questions  were  relatively  neutral 
statements  allowing  the  respondent  to  express  his  perceptions 
on  both  the  old  and  new  OER  system.  Officers  were  asked  to 
respond  to  some  questions  using  a Likert-type  scale  on  which 
they  could  express  their  degree  of  agreement  with  the 
statement  in  terms  of  a seven  point  scale  from  strongly 
agree,  neutral/no  opinion  to  strongly  disagree.  Other 
questions  had  answers  which  were  of  a multiple-choice 
variety.  One  question  asked  the  respondent  to  list  the 
choices  in  a preferential  order.  While  the  second  and 
third  sections  contained  questions  on  both  the  old  and  new 
system,  the  fourth  section  contained  questions  pertaining 
to  perceptions  of  only  the  new  OER  system. 

Each  officer  was  individually  provided  with  a 
questionnaire  to  complete  and  return  at  their  own  discretion. 
The  officers  were  allowed  a couple  of  days  and  completed 
questionnaires  were  returned  to  several  collection  points. 

The  distribution  and  collection  of  questionnaires  was 
accomplished  by  SOS  personnel.  These  procedures  resulted 
in  an  overall  return-rate  of  approximately  80$. 
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Questionnaire  Development 

Initially,  the  author  comprised  a list  which  was  thought 
to  contain  tnose  factors  which  are  most  important  in  influenc- 
ing the  rating  an  individual  receives  under  either  the  old 
or  new  OER  system.  After  discussions  with  many  other 
individuals  and  sessions  with  both  reader  and  advisor,  the 
list  was  narrowed  to  eighteen  factors. 

Questions,  other  than  those  concerning  the  eighteen 
factors,  were  developed  at  the  same  time.  The  author,  after 
reading  an  Air  Command  and  Staff  College  (ACSC)  paper  dealing 
with  the  OER,  decided  to  include  two  questions  from  the 
forementioned  paper  (Ref  3) . The  authors  of  the  ACSC 
paper  found  that  a significant  portion  of  the  responses  to 
their  survey  questions  were  in  the  Neutral/No  Opinion 
category.  This  was  not  surprising  due  to  the  fact  that  the 
new  OER  system  was  implemented  in  November  of  1974,  and  the 
ACSC  questionnaire  was  administered  in  November  and  December 
of  1974.  The  two  questions  were  included  to  observe  the 
shift  in  the  perceptions  of  SOS  students  eighteen  months 
later . 

While  the  author  was  developing  his  questionnaire,  he 
received  additional  input  in  the  form  of  some  questions  from 
the  Commander  of  a Systems  Command  Laboratory  who  was  also 
investigating  perceptions  of  the  OER,  but  was  sampling  a 
much  smaller  and  different  group.  This  input  resulted  in 
some  additional  questions  concerning  only  the  new  OER 
system. 
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After  the  questionnaire  was  completed,  a sample- 
pre-test  was  given  to  57  officers  while  the  questionnaire  went 
through  the  official  survey  approval  channels.  Following 
the  pre-test,  the  questionnaire  was  revised  and  updated. 

The  pre-test  was  accomplished  to  check  clarity,  readability, 
ease  of  answering  and  completeness.  The  pre-test  turned  out 
to  be  invaluable  and  the  comments  and  suggestions  were 
evaluated  and  incorporated  where  appropriate.  The  revisions 
were  also  sent  through  the  proper  channels.  An  official 
approval  and  a survey  control  number  (USAF  SCN  7T-06)  were 
forthcoming.  Upon  receipt  of  the  survey  control  number, 
the  questionnaire  was  mailed  to  SOS. 

Data  Analysis 

The  use  of  the  Likert-type  scale  not  only  provides  the 
respondent  with  a sufficient  range  of  answers,  but  also 
provides  for  easy  data  interpretation.  Even  with  a 
simplistic  numerical  count  method,  the  relative  positive 
or  negative  attitude  toward  a statement  can  be  seen.  Such 
a method  is  extremely  useful  in  determining  the  group 
attitude  toward  any  aspect  of  the  OER  system.  The  reader 
can  easily  get  a feel  for  how  any  segment  of  the  survey 
group  responds  to  a particular  question.  However,  each 
question  must  be  considered  in,  and  of,  itself.  Grouping 
questions  to  try  to  get  an  overall  score  would  distort  the 
true  worth  of  the  data.  There  are  questions  which,  due  to 
their  natural  similiarity,  by  pairing  yield  more  information 
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than  they  would  if  each  were  considered  separately.  For 
example,  a perception  concerning  a particular  statement 
about  the  old  OER  system  is  much  more  meaningful  when 
compared  to  the  perception  of  that  statement  about  the 
new  OER  system. 

In  order  to  calculate  the  significance  of  the  difference 
in  perceptions,  a paired  T-Test  was  used.  A paired  T-Test 
was  used  due  to  the  fact  that  the  two  responses  are  not 
independent.  Using  the  paired  T-Test  as  an  analytical  tool, 
the  following  hypothesis  was  tested  for  each  factor. 

Hq:  mean  perception  = mean  perception  ngw 


H^:  mean  perception 


f mean  perception 


new 


In  order  to  maintain  a high  degree  of  confidence,  only  those 
differences  with  a 5%  or  less  degree  of  chance  cf  occurring 
randomly  will  be  considered  significant.  The  paired  T-Test 
will  be  used  to  analyze  all  the  data  presented  in  Section  I 
of  Chapter  III. 

In  Section  II  of  Chapter  III,  simple  percentages  will 
be  used  to  present  the  author's  data.  In  Section  III  of 
Chapter  III,  simple  percentages  will  also  be  used  to  present 
the  author’s  data,  except  in  those  cases  where  the  author 
specifically  states  otherwise.  Additional  and  more  complex 
analytical  methods,  such  as  regression  analysis  and  canonical 
correlation  were  used  on  the  data,  however,  the  author  was 
unable  to  detect  any  meaningful  correlations. 
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Data  Presentation 

Out  of  660  questionnaires  distributed  to  Class  76-C  of 
Squadron  Officers  School,  Maxwell  Air  Force  Base,  Alabama, 

541  were  completed  and  returned.  During  a screening  session 
four  were  eliminated  for  containing  invalid  responses.  The 
remaining  537  were  subsequently  broken  into  5 categories 
(based  on  the  rating  the  individual  received  from  his  review- 
ing official) . These  were  used  for  all  analytical  work  done 
in  this  study.  The  breakdown  of  categories  is  as  follows: 

Category  Number  of  Respondents 

l's  203 

2's  134 

3'a  68 

Total  405 

No  Score  132 

The  first  category  being  those  officers  who  received 
a top-block  rating  from  their  reviewing  official,  the  second 
category  being  those  officers  who  received  a second-block 
rating,  and  third  category,  those  officers  who  received  a 
third-block  rating.  The  fourth  category  contains  individuals 
who  either  have  not  been  evaluated  under  the  new  OER, 
received  an  abbreviated  OER  (under  an  abbreviated  OER,  the 
controlled  potential  block  is  not  marked) , or  did  not  know 
their  OER  scores. 

Initially,  it  was  the  intention  of  the  author  to 
combine  the  first  three  categories  into  another  category 
to  represent  an  overall  view  of  those  officers  who  had  been 
evaluated  under  the  new  OER  system.  However,  after  the 
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initial  look  at  the  data,  this  procedure  was  not  deemed 
appropriate.  Due  to  the  selection  -ocess  for  attending 
SOS,  the  scores  received  by  the  officers  attending  SOS  were 
significantly  higher  than  chose  received  by  junior  officers 
of  the  Air  Force  as  a whole.  While  the  Air  Force  distribu- 
tion of  reviewer  scores  must  meet  the  22-28-50  percentages 
dictated  by  Air  Force  for  top-block,  second-block  and  third- 
block  ratings,  SOS  students  do  not  meet  this  controlled 
distribution.  Ironically,  the  distribution  of  scores  for 
the  sample  group  is  almost  opposite  of  controlled  distribution, 
50?S  received  top-block  ratings,  33+5S  received  second-block 
ratings  and  16 % received  third-block.  If  a correction  was 
not  made,  then  the  data  from  the  total  category  would  be 
heavily  influenced  by  those  who  received  a top-block  score. 

In  order  to  have  a "total"  category  which  would  represent 
the  Air  Force  distribution  of  scores,  a weighting  correction 
was  used  to  transpose  the  data  from  the  actual  50-33-16 
distribution  into  a 22-28-50  distribution. 

The  weighting  was  accomplished  in  the  following  manner. 

The  individual  responses  of  the  203  officers  receiving  a 1 
from  their  reviewing  official  were  multiplied  by  .4389,  thus, 
the  203  respondents  were  weighted  so  as  to  only  make  89.1 
respondents.  The  officers  receiving  2’s  and  3’s  were 
weighted  by  .8463  and  2.9779,  respectively.  The  result  of 
the  weighting  was  that  the  original  number  of  respondents 
(405)  was  not  changed,  just  the  relative  composition  of 
reviewer  scores  was  changed. 
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This  weighting  correction  allows  the  data  '.o  more  fair 
ly  represent  the  junior  officer  in  the  Air  Force.  However, 
no  correction  was  made  for  the  "conservative"  aspect 
described  in  Chapter  I.  This  results  in  a total  of  five 
categories  for  presentation;  top-block,  second-block, 
third-block,  no  scores,  and  a weighted  total. 
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CHAPTER  III 
Findings 

The  following  chapter  is  devoted  to  an  analysis  of  the 
responses  to  the  questionnaire  using  the  methodology  des- 
cribed in  Chapter  II.  The  discussion  is  divided  into  three 
sections  corresponding  to  the  last  three  sections  of  the 
questionnnaire.  The  first  section  deals  with  the  perceptions 
of  junior  officers  concerning  the  eighteen  factors  and  the 
amount  of  influence  these  factors  have  on  OER  ratings  under 
the  old  and  new  system.  The  second  section  discusses  the 
choices  the  officers  made  as  to  what  is  the  most  influential 
factor  under  both  systems.  The  third  section  presents  some 
discussion  on  issues  dealing  primarily  with  some  of  the 
unique  features  of  the  new  OER  system. 

Section  I 

Introduction 

The  following  section  contains  an  analysis  of  the 
factors  eluded  to  in  Chapter  II.  Below  is  a typical 
question  the  officer  was  asked  to  answer  in  Section  II  of 
the  questionnaire. 

13.  PHYSICAL  APPEARANCE  influences  the  rating  an  individual 
receives. 


OLD 

1 

2 

3 4 

5 

6 7 

NEW 

1 

2 

3 4 

5 

6 7 

Strongly 

Neutral/ 

Strongly 

Disagree 

No  Opinion 

Agree 
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The  respondent  was  asked  to  answer  the  questions  one  at  a 
time  and  independently  of  each  other.  By  presenting  the 
choices  of  answers  to  the  old  and  new  system  close  to  each 
other,  the  respondent  could  visually  see  his  perceived 
difference  in  influence  between  the  two  systems.  (In 
addition,  it  took  more  physical  effort  to  show  a difference 
such  as  marking  a 2 and  a 6 than  no  difference,  such  as 
marking  a 3 and  a 3) . 

Factors 

The  eighteen  factors  selected  and  used  in  this  study 
are  found  in  Table  I.  These  factors  appear  in  the  order 
corresponding  to  their  appearance  in  the  questionnaire. 

When  interpreting  the  data,  the  reader  should  consider  the 
fact  that  some  factors  may  have  been  viewed  by  the  respon- 
dents in  several  different  lights.  For  example,  visibility 
has  both  positive  and  negative  aspects.  If  an  officer 
fulfills  the  "whole  man"  concept,  he  will  naturally  receive 
positive  visibility,  while  the  negative  aspects  may  come 
from  those  officers  who  seek  visibility  for  the  sake  of 
visibility  itself.  Both  of  these  aspects,  as  well  as 
others,  may  have  been  combined  by  the  respondent  and  trans- 
cribed into  the  answer  chosen.  A discussion  of  some  of  the 
eighteen  factors  follows  Table  I. 
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Table  I 


Factors  Contained  in  the  Survey 


PHYSICAL  APPEARANCE 

UPCOMING  PERMANENT  CHANGE  OF  STATION 

LENGTH  OF  TIME  IN  A JOB 

EDUCATIONAL  LEVEL 

SPECIAL  ASSIGNMENTS 

SOURCE  OF  COMMISSION 

ADDITIONAL  DUTIES 

PROFESSIONAL  MILITARY  EDUCATION 

RATED  VS.  NON-RATED 

JOB  PERFORMANCE 

DIVERSITY  OF  PRIOR  ASSIGNMENTS 
ESTABLISHED  DATE  OF  SEPARATION 
PRIMARY  ZONE  FOR  PROMOTION 
NON- JOB  RELATED  MISFORTURE 
VISIBILITY 

RELATIONSHIP  BETWEEN  RATING  OFFICIALS 
LEVEL  OF  ASSIGNMENT 
JOB  STATUS 
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SPECIAL  ASSIGNMENTS  influence  the  rating  an  individual 
receives . 


Category 

No.  of  Respondents 

Mean 

Prob 

l's 

193 

OLD 

5.1969 

NEW 

5.4041 

.048 

2 ' s 

126 

OLD 

5.3492 

NEW 

5.1746 

.261 

3*s 

66 

OLD 

5.3485 

NEW 

5.2273 

.618 

No- Score 

127 

OLD 

5.4488 

NEW 

5.1260 

.034 

Total 

387 

OLD 

5.3156 

NEW 

5.2514 

.483 

Of  the  eighteen  factors  involved,  only  one  factor 
decreased  in  influence  under  the  new  OER  system.  This  factor 
being  SPECIAL  ASSIGNMENTS , while  all  of  the  other  seventeen 
factors  increased  in  influence. 

The  probability  of  the  difference  in  means  of  the  Total 
group  shows  a high  degree  of  chance.  In  a recent  letter- to 
the  "Air  Force  Times",  an  officer  presented  his  criticism 
of  the  new  OER  system,  one  of  his  points  was  that  SPECATS 
would  become  less  attractive.  The  official  Air  Force  reply 
did  not  address  the  issue  of  SPECAT  applications  either 
increasing  or  decreasing.  Instead,  the  reply  was  that 
officers  in  SPECAT  were  doing  "somewhat"  better  than  those 
not  in  a SPECAT  assignment  as  far  as  promotion  boards  are 
concerned  (Ref  5:17). 

While  the  Total  group  shows  an  insignificant  decrease, 
the  l's  show  a significant  increase.  The  reason  behind  the 
perception  of  the  l's,  may  be  that  since  they  have  been 
rewarded  by  the  system,  they  feel  that  the  system  will  have 
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other  compensating  effects  for  the  officers  in  SPECAT 
assignments.  The  general  impression  the  author  has  observed 
is  that  officers  do  not  feel  the  rewards  are  adequate  for  the 
increase  competition  present  in  SPECAT-manned  organizations. 
The  research  efforts  of  Carr  and  Rhoades  tend  to  support  this 
impression.  The  Carr  study  found  62.0  percent  of  the 
officers  not  opposing  a SPECAT  assignment.  The  Rhoades 
study  found  only  35.5  percent  of  the  officers  willing  to 
actively  seek  a SPECAT  assignment  (Ref  13:104).  While 


1 


the  two  studies  occurred  about  a year  apart  and  the  questions 
were  slightly  different,  the  results  tend  to  support  the 
author's  impression. 

Since  offi  irs  in  SPECAT  assignments  are  under  the  same 
OER  rating  distribution  as  those  officers  not  in  SPECAT 
assignments,  the  perception  may  not  be  that  SPECAT  officers 
will  get  more  than  their  share  of  higher  ratings , but  will 
receive  compensating  consideration  by  promotion  boards. 

The  only  statistical  data  available  relating  to 
this  perception,  was  presented  in  a briefing  by  a ranking 
Air  Force  officer  (Ref  9) . 


Temporary  Captain  Board  (Jan  76) 
Agency  Eligible  Promoted 

12  3 


4 

t 

% 

Joint  S Departmental 

3164 

1005 

1005 

855 

3 

MAJCOM  S BELOW 

91 

1005 

1005 

895 

I 
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4 Due  to  the  high  percentage  of  officers  that  are  promoted 

to  captain,  the  only  difference  occurred  between  the  groups 
of  officers  receiving  a 3 on  their  OER.  While  this 
difference  is  relatively  small,  the  statistics  for  officers 
facing  more  competitive  promotion  boards  did  show  SPECAT 
officers  doing  significantly  better;  this  data  supports  two 
different  attitudes  (lief  9)  . One  attitude  might  be  that 
due  to  the  increased  competition  in  SPECAT  assignments,  even 
if  an  officer  were  to  receive  less  than  a top  rating,  his 
chance  of  promotion  would  be  greater  since  promotion  boards 
are  compensating  for  the  selectively  manned  SPECAT  assign- 
ments. The  other  attitude  might  be  that  by  staying  out  of 
the  highly  competitive  atmosphere  of  SPECAT  assignments,  an 
officer  has  a better  chance  of  a top  rating  and  thus  not 
having  to  risk  the  compensating  effect  of  promotion  boards 
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AN  ESTABLISHED  DATE  OF  SEPARATION  (DOS)  influences  the 
rating  an  individual  receives. 


Category  No 

. of  Respondents 

Mean 

Prob. 

l*s 

193 

OLD 

4.7876 

NEW 

6.1192 

.000 

2 1 s 

126 

OLD 

4.6032 

NEW 

6.4048 

.000 

3 1 s 

66 

OLD 

4.8788 

NEW 

6.3636 

.000 

No  Score 

127 

OLD 

5.2283 

NEW 

6.2520 

.000 

Total 

387 

OLD 

4.7831 

NEW 

6.3216 

.000 

Within 

the  Total  and  2* 

s categories , 

the 

factor 

with 

the  largest  difference  in  means  is  an  ESTABLISHED  DOS.  While 
Air  Force  Regulation  36-10  prohibits  officers  with  a DOS, 
who  are  near  the  separation  date,  from  receiving  a controlled 
OER  under  the  new  system,  those  not  near  separation  are 
evaluated  under  the  controlled  distribution.  The  practice 
of  using  officers  with  an  ESTABLISHED  DOS  to  "fill-in"  the 
bottom  of  the  distribution  does  not  necessarily  go  against 
Air  Force  policy.  In  fact,  those  officers  who  have  indicat- 
ed their  desire  to  leave  the  Air  Force,  have  little 
potential  as  far  as  the  Air  Force  is  concerned. 

Under  the  old  system  with  the  inflated  scores,  there 
was  no  impact  on  other  officers  if  an  officer  with  a DOS 
received  a top  rating.  Junior  officers  now  perceived  that 
any  officer  with  a DOS  will  be  used  by  the  evaluators  to 
"fill-in"  the  bottom  of  the  distribution.  The  distribution 
allows  100)1  of  the  officers  to  be  included  in  the  top  three 
blocks,  therefore,  there  is  no  need  when  "filling-in"  to 
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rate  below  a third-block  rating.  As  a result,  officers 
with  little  or  no  potential  may  be  found  in  that  5055  of  the 
officers  receiving  3*s„ 

Air  Force  Regulation  36-10  prohibits  the  tactic  of 
using  certain  officers  to  "fill-in"  by  either  removing  them 
from  the  distribution  quota  or  requiring  "abbreviated 
reports"  which  do  not  have  the  control  distribution 
potential  block  marked.  An  example  is  a promotion  selectee. 
The  selectees  receive  an  abbreviated  report  until  actual 
promotion  takes  place. 

Both  the  Carr  and  Rhoades  studies  support  the  perception 
that  officers  with  a DOS  will  be  used  to  fill-in  the  bottom 
of  the  distribution.  The  Carr  study  found  that  5555  of  the 
officers  believed  this  filling-in  would  take  place.  The 
Rhoades  study  asked  a somewhat  broader  question  when  they 
included  passed-over  officers  along  with  officers  with  a 
DOS.  With  the  inclusion  of  passed-over  officers,  80S  of 
the  officers  felt  that  these  type  officers  would  be  used 
in  the  filling-in  process  (Ref  14:90) . 

There  was  no  statistical  data  dealing  with  the  DOS 
perception.  However,  some  data  was  available  concerning 
passed-over  officers  (Ref  9,  7:10). 


While  these  figures  deal  only  with  passed-over  officers, 
the  author  believes  that  officers  with  an  established  DOS 
would  receive  even  less  top  ratings.  The  basis  for  this 
opinion  is  that  reviewers  probably  view  a DOS  as  a state- 
ment of  potential  within  the  Air  Force  environment. 
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BEING  IN  THE  PRIMARY  ZONE  FOR  PROMOTION  influences  the  rating 
an  individual  receives. 


Category 

No.  of  Respondents 

Mean 

Prob. 

l's 

193 

OLD 

5.0984 

NEW 

6.1813 

.000 

2 ’ s 

126 

OLD 

5.2063 

NEW 

6.5238 

.000 

3‘s 

66 

OLD 

5.2727 

NEW 

6.6364 

.000 

No  Score 

127 

OLD 

5.2164 

NEW 

6.3543 

.000 

Total 

387 

OLD 

5.2164 

NEW 

6.5061 

.000 

Within  the  3's  and  No  Score  categories,  the  factor  with 
the  largest  difference  in  means  was  BEING  IN  THE  PRIMARY  ZONE 
FOR  PROMOTION.  This  factor,  within  the  Total  category,  had 
the  second  largest  change  in  means.  One  of  the  main  reasons 
for  this  perception  may  be  in  the  principle  of  one  type  of 
gaming.  Gaming  is  the  process  whereby  those  senior  in  rank 
(thus  up  for  promotion)  are  given  the  higher  ratings  and 
those  junior  in  rank  (thus  not  up  for  promotion)  are  given 
the  lower  ratings.  Thus,  gaming  is  not  supposed  to  hurt 
anyone,  yet  "beat  the  system".  The  rationale  being  that  by 
giving  those  in  the  PRIMARY  ZONE  l's  and  telling  the  junior 
officers  not  be  concerned  with  the  3's  they  are  receiving 
because  they  will  get  the  l's  when  they  become  the  senior 
officer. 

Air  Force  admits  that  the  trend  of  gaming  is  evident, 
yet  there  is  no  cause  for  concern  because  gaming  is  net 
blatant  (Ref  8:3).  Officials  also  state  they  expect  to 
see  a higher  percentage  of  PRIMARY  ZONE  officer  receiving 
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top  scores.  The  reasoning  behind  this  expectation  being 
senior  officers  have  worked  their  way  to  higher  levels  of 
responsibility  and  authority  and  thus  have  more  potential. 

Regardless  of  whatever  underlies  the  basis  for  the 
perception/  the  data  available  supports  the  perception  that 
officers  in  the  primary  zone  have  an  edge  over  officers  not 
in  the  primary  zone  for  promotion  when  it  comes  to  receiving 
top-block  ratings.  Over  75  percent  of  the  officers  surveyed 
by  both  Carr  and  Rhoades  share  the  perception  (Ref  4:89). 

The  advantage  for  first  time  eligibles  was  apparent  in 
the  first  temporary  colonel  board  to  use  the  controlled  OER; 

39.7  percent  of  the  officers  with  a controlled  OER  received 
a Block  1 rating,  31.5  percent  received  a Block  2 rating  and 

28.8  percent  received  a Block  3 or  lower  rating  (Ref  7:1C). 

Data  for  other  grades  is  as  follows:  (Ref  9). 
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♦ 

Promotion  Eligibility  Category 


6 


t 

Not 

Eligible 

Secondary 

Zone 

Primary  Zone 
(First  Time) 

Lt.  Colonel 

IT 

b 

Block  1 

7.3% 

27.055 

37.4% 

? 

i 

Block  2 

36.9% 

36.6% 

29.8% 

Blocks  3-6 

55.3% 

36.4% 

32.8% 

l 

A 

Major 

Block  1 

21.2% 

22.155 

27.6% 

i 

1 

Block  2 

31.855 

37.755 

30.3% 

r 

■- 

Blocks  3-6 

41.055 

45.255 

42.1% 

■ 

Captain 

■- 

Block  1 

12.7 % 

24.955 

33.9% 

l 

Block  2 

25.055 

30.1% 

33.8% 

i 

t 

Blocks  3-6 

62.355 

45.0% 

32.3% 

\ 

Lieutenant 

\ 

\ 

r 

|» 

Block  1 

22.055 

— 

21.2% 

\ 

[ 

Block  2 

28.7 % 

— 

27.5% 

\ 

Blocks  3-6 

49.355 

— 

51.3% 

I 


I 


i 

t 

i 


Air  Force  officials,  in  releasing  these  figures,  said 
that  as  a year  group  grows  in  responsibility  and  experience 
the  groups  share  of  top  ratings  will  increase.  By  expressing 
this  viewpoint  the  Air  Force  in  a round  about  way  has 
supported  and  lent  credibility  to  the  gaining  process.  Prior 
to  the  release  of  the  data,  there  had  been  rumors  that 
gaining  was  occurring  in  an  attempt  to  "beat  the  system" 
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VISIBILITY  (with  higher  level  rating  officials)  influences 
the  rating  an  individual  receives. 


Category 

No.  of  Respondents 

Mean 

Prob. 

l*s 

193 

OLD 

5.4819 

NEW 

6.5026 

.000 

2*  s 

125 

OLD 

5.4683 

NEW 

6.5556 

.000 

3*s 

66 

OLD 

5.3939 

NEW 

6.5606 

.000 

No  Score 

127 

OLD 

5.8346 

NEW 

6.5984 

.000 

Total 

387 

OLD 

5.4336 

NEW 

6.5465 

.000 

Within  the  l's  category,  the  factor  with  the  largest 
difference  in  means  was  VISIBILITY.  Before  any  interpretation 
in  the  shift  of  means  can  be  made,  one  must  stop  to  consider 
what  "VISIBILITY"  is.  The  author  deliberately  left  the 
definition  or  interpretation  of  VISIBILITY  to  the  individual 
respondent.  The  reason  being  that  the  word,  "VISIBILITY,  is 
one  that  is  quite  often  heard  when  discussion  about  the  OER 
system  is  taking  place.  VISIBILITY  has  both  positive  and 
negative  aspects  and  the  respondents  were  left  the 
opportunity  to  use  whatever  personal  definition  best  suited 
their  perceptions.  VISIBILITY  can  come  from  many  sources, 
such  as: 


1.  Job  Performance 

2.  Personal  Contact  (Social  and  Job-related) 

3.  Additional  Duties 

4.  Non-Job  Related  Misfortunes 

5.  Civic  Activity 

6.  Physical  Activity 
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These  and  other  sources  may  make  up  the  definition  of 
VISIBILITY  used  by  the  respondent.  Regardless  of  the 
definition,  the  perception  of  VISIBILITY  has  increased  in 
importance  in  influencing  the  rating  an  individual  receives. 

To  say  that  VISIBILITY  is  all  positive  or  negative 
would  lead  to  erroneous  interpretations.  The  officer  who 
fulfills  the  Air  Force  "whole  man"  concept  will  quite 
naturally  attain  some  VISIBILITY.  On  the  other  hand,  there 
may  exist  individuals  who  attain  some  of  the  negative  aspects 
of  VISIBILITY  due  to  unfortunate  circumstances.  For 
example,  those  officers  who  do  not  engage  in  some  social 
activities  may  achieve  some  negative  VISIBILITY. 

Other  aspects  of  VISIBILITY  that  must  be  considered  are 
the  amount  of  VISIBILITY  and  the  control  of  VISIBILITY  that 
the  individual  possesses.  The  officer  who  is  physically 
located  some  distance  from  his  evaluators  may  not  have  the 
same  opportunities  for  VISIBILITY  as  the  officer  who  is 
stationed  near  or  with  his  evaluators.  The  officer  who 
frequently  comes  in  personal  contact  with  his  evaluators 
has  a greater  opportunity  than  an  officer  who  seldom  comes 
in  contact  with  his  evaluators.  With  the  perception  of  the 
increased  importance  of  VISIBILITY,  it  may  become  important 
that  all  officers  have  the  same  opportunities  for  VISIBILITY. 

To  possibly  gain  a better  insight  to  the  overall 
VISIBILITY  factor , two  other  factors  can  be  considered. 

I)'  that  VISIBILITY  can  be  considered  to  have  both  positive 
and  negative  aspects,  by  1c  okin.g  at  these  separate  aspects, 
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the  overall  VISIBILITY  factor  can  better  be  comprehended. 

By  accepting  JOB  PERFORMANCE  as  a positive  aspect  and  NON-JOB 
RELATED  MISFORTUNE  as  a negative  aspect,  two  additional  views 
of  VISIBILITY  can  be  seen.  Both  JOB  PERFORMANCE  and  NON-JOB 
RELATED  MISFORTUNE  increase  significantly  in  influence  in  all 
categories . 

The  fact  that  both  JOB  PERFORMANCE  and  NON-JOB  RELATED 
MISFORTUNE  increase  significantly  would  tend  to  show  that 
neither  the  positive  nor  the  negative  aspects  alone 
accounted  for  the  increased  importance  of  VISIBILITY  under 
the  new  OER  system.  The  significant  increase  in  importance 
of  both  JOB  PERFORMANCE  and  NON-JOB  RELATED  MISFORTUNE  is  an 
important  fact  in  and  of  itself.  Officers  perceive  that 
their  JOB  PERFORMANCE  is  more  important  under  the  new  OER 
than  under  the  old  OER  system.  Likewise,  officers  feel 
that  "screw-ups"  off  the  job  will  play  an  increasing  role 
in  influencing  the  rating  they  receive  under  the  new  OER 
system.  Whether  NON-JOB  RELATED  MISFORTUNE  should  or  should 
not  influence  the  rating  an  individual  receives  is  not  the 
pel?-,  at  issue;  the  point  is  that  officers  perceive 
misfortunes  to  have  increased  in  influence.  Whether  or  not 
NON-JOB  RELATED  MISFORTUNES  are  included  in  the  "whole-man 
concept"  and  ultimately  in  the  rating  an  individual  receives 
may  be  a valid  issue.  The  perception  exists  that  off-the-job 
screw-ups  will  be  considered  by  the  officers  evaluating  an 
officer’s  potential. 
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Visibility  and  Misfortunes  are  not  only  hard  to  define, 
but  also  difficult  to  detect  and  measure.  By  looking  at 
one  aspect  of  visibility,  perhaps  some  insight  as  to  the 
importance  of  visibility  can  be  gained.  The  frequency  of 
contact  between  the  ratee  and  reviewer  has  often  been 
mentioned  as  being  part  of  visibility.  The  Carr  study  found 
that  89.5  percent  of  the  officers  felt  that  the  frequency 
of  contact  would  be  an  important  consideration  (Ref  3:56). 
When  the  Rhoades  study  asked  the  same  question,  approximately 
a year  later,  95.3  percent  of  the  officers  agreed  that 
frequency  of  contact  was  important  (Ref  13:93).  Not 
only  is  the  actual  contact  important,  but  also  the 
opportunity  for  contact.  When  the  two  studies  asked  if  an 
officer  who  was  geographically  separated  from  his  rater 
and/or  reviewer  would  suffer  under  the  new  OER  system;  over 
80  percent  felt  he  would  (Ref  13:100). 
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LENGTH  OF  TIME  IN  A JOB  influences  the  rating  an  individual 
receives . 


Category 

No.  of  Respondents 

Mean 

Prob. 

I's 

193 

OLD 

4.7254 

NEW 

5.9534 

.000 

2 ' s 

126 

OLD 

4.8413 

NEW 

6.0056 

.000 

3's 

66 

OLD 

4.9242 

NEW 

6.2576 

.000 

No  Score 

127 

OLD 

4.9528 

NEW 

6.0866 

.000 

Total 

387 

OLD 

4.8586 

NEW 

6.1356 

.000 

The  perception  underlying  the  increased  importance  of 
LENGTH  OF  TIME  IN  A JOB  under  the  new  OER  system  is  that  the 
longer  an  officer  is  in  a job  the  more  likely  are  his  chances 
of  receiving  a higher  rating.  The  theory  is  that  the  new 
officer  having  less  time  to  become  proficient  and  competent 
as  compared  to  the  "old  head"  has  less  of  an  opportunity  to 
demonstrate  potential.  An  assumption  that  might  follow  from 
the  new  man  syndrome  is  that  officers  will  be  less  willing 
to  change  jobs  and  those  officers  who  do  change  jobs  or 
stations  might  feel  that  they  are  at  a disadvantage  in 
receiving  top  ratings.  If  the  new  man  getting  lower  ratings 
were  to  become  a reality  the  consequences  could  be 
significant. 

The  obvious  result  would  be  for  officers  to  attempt  to 
game  their  moves  so  as  to  receive  the  lower  rating  at  a 
point  in  their  career  where  it  would  be  least  detrimental. 

A typical  example  would  be  for  officers  coming  into  the 
primary  zone  to  try  to  delay  or  avoid  reassignment  until 


38 


- aaaa  aacia 


GSM/SM/76D-32 

after  passage  of  this  critical  career  point.  Additionally, 
those  officers  who  were  to  make  several  quick  moves  might 
feel  they  were  being  wronged  in  that  these  officers  were 
never  in  one  job  long  enough  to  become  an  old  head.  The 
evaluators  might  also  use  these  temporary  officers  to  fill 
in  the  lower  ratings  while  saving  the  higher  ratings  for 
the  permanent  personnel. 

Normally,  the  officer  who  is  new  on  the  job  is  given 
some  time  to  get  acclimated  before  he  is  given  the  authority 
and  responsibility  with  which  to  demonstrate  potential.  The 
Air  Force  policy  of  attempting  to  stabilize  assignments  will 
help  compensate  the  new  officer  by  providing  enough  time 
in  a job  for  an  officer  to  become  an  old  head.  However, 
there  are  those  officers  whose  frequent  moves  may  leave 
them  at  a distinct  disadvantage.  The  author,  for  example, 
has  made  five  moves  in  only  six  and  a half  years.  Without 
job  stability  he  probably  is  at  a disadvantage  to  those 
officers  with  more  stable  job  lengths. 

There  was  some  data  available  dealing  with  the  percep- 
tion of  LENGTH  OF  TIME  IN  A JOB.  The  data  is  as  follows 
(Ref  9 ) . 
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Less  Than  Six  Months  On  Base 


Block  1 

Block  2 

Colonel 

39.2$ 

30.4$ 

Lt.  Colonel 

to 

o 

• 

-*4 

34.0$ 

Major 

19.6$ 

30.2$ 

Captain 

17.0$ 

27.9$ 

Lieutenant 

9.2$ 

17.7$ 

The  officers  in  the  grade  of  major  and  above  tended  to  do 
better  than  the  officers  in  the  grades  of  captain  and 
lieutenant.  While  this  data  suggests  that  the  new  officers 
on  base  do  as  well  as,  or  better  than,  officers  who  have  been 
on  base  a longer  period  of  time,  certain  clarifications 
should  be  made.  For  an  officer  to  receive  a controlled  OER, 
he  must  normally  be  under  the  rater's  supervision  for  120 
days.  Therefore,  an  officer  who  has  been  oj  base  less  than 
four  months  and  received  a controlled  OER  will  be  receiving 
his  OER  from  the  evaluators  at  his  prior  base,  based  on 
supervision  at  the  prior  base  (Ref  4:13).  As  a result 
of  this  policy,  this  data  contains  officers  who  received 
OER's  from  their  former  base  after  they  departed  and  officers 
who  met  supervision  requirements  at  their  new  base. 
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An  UPCOMING  PCS  influences  the  rating  an  individual  receives. 


Category 

No.  of  Respond1 

ents 

Mean 

Prob. 

l’s 

193 

OLD 

3.5285 

NEW 

4.7461 

.000 

2 ' s 

126 

OLD 

3.4921 

NEW 

5.1111 

.000 

3's 

66 

OLD 

3.7879 

NEW 

5.1970 

.000 

No  Score 

127 

OLD 

4.0472 

NEW 

5.0749 

.000 

Total 

387 

OLD 

3.6499 

NEW 

5.0749 

.000 

An  UPCOMING  PERMANENT  CHANGE  OF  STATION  (PCS)  may  be 
considered  a corollary  to  the  previous  factor  of  LENGTH  • • •' 
TIME  IN  A JOB.  The  perception  being  that  those  officers 
facing  a PCS  may  not  receive  the  same  consideration  for  top 
ratings  as  those  officers  who  are  not  moving.  The  reasoning 
being  that  the  evaluator  will  not  use  his  higher  ratings  on 
those  individuals  who  will  no  longer  be  his  concern;  i.e., 
if  someone  has  to  receive  a low  rating,  let  it  be  the 
individual  who  will  no  longer  be  around.  The  perception  of 
lower  ratings  for  officers  with  an  UPCOMING  PCS  must  be 
weighed  against  the  perception  of  higher  scores  for  those 
individuals  with  a long  time  in  a job. 

Many  interpretations  of  the  weighting  of  the  two  percep- 
tions can  be  suggested.  The  officer  with  a long  time  in  his 
job  who  is  going  PCS  shortly  after  the  time  when  his  OER  must 
be  available  to  him,  may  receive  a rating  unbiased  by  either 
of  the  perceptions.  Yet,  the  officer  who  has  only  been  in 
his  job  relatively  a short  time  and  is  going  PCS  before  his 
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OER  is  available  to  him,  may  receive  a rating  biased  by 
both  perceptions. 

An  interesting  facet  of  the  UPCOMING  PCS  is  that  under 
the  old  OER  system,  the  mean  in  all  categories  was  at  or 
below  the  NEUTRAL/NO  OPINION  point  in  influence.  While, 
under  the  new  OER  system,  the  mean  in  all  categories  was  in 
the  range  that  reflected  agreement  as  to  this  factor  having 
influence.  The  significant  shift  in  means  indicates  that  an 
UPCOMING  PCS  might  have  had  little,  or  no,  influence  under 
the  old  OER  system,  but  under  the  new  OER  system  it  has  some 
influence.  The  positive,  or  negative  aspect  of  the  perception 
depends  on  the  particular  circumstances  involved  as  discussed 
previously. 

The  perception  that  length  of  time  in  a job  is  influential 
in  determining  the  rating  an  officer  receives,  is  complicated 
by  the  new  OER  procedures.  All  the  officers  in  the  same 
grade  have  their  OER  closed-out  or  completed  on  the  same  day. 
This  policy  coupled  with  the  120  days  of  supervision  policy, 
has  resulted  in  another  policy.  Any  officer  who  departs 
PCS/PCA  within  a four  month  "window"  prior  to  the  close-out 
day,  will  have  his  OER  held  and  completed  at  his  prior  base 
of  assignment.  The  result  of  these  procedures  may  explain 
part  of  the  perception. 

Presented  are  the  statistics  dealing  with  some  of 
the  perceptions  concerning  the  length  of  time  in  a job 
(Ref  9) . 
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PCS/PCA  During  Cycle  Window 


Block  1 

Block  2 

Major 

23.2$ 

30.4$ 

Captain 

26.7$ 

29.5$ 

Lieutenant 

27.0$ 

31.8$ 

PCS  Projected  Within  Tour  Months  After  Cycle 

Block  1 

Block  2 

Colonel 

28.9$ 

29.6$ 

Lt  Colonel 

25.8$ 

31.3$ 

Major 

'5.4$ 

29.6$ 

Captain 

24.6$ 

29.4$ 

Lieutenant 

27.4$ 

28.8$ 

These  figures  do  not 

support  the 

perception  that 

officers  who  are  departing 

(or  who  soon  will  be)  will 

at  a disadvantage  in  receiving  top-block  ratings.  On  the 
contrary,  the  departing  officers  do  better  than  the  officers 
who  stay  behind.  Normally,  the  officers  departing  are  the 
ones  who  have  been  at  the  job  the  longest.  Therefore,  these 
statistics  tend  to  support  the  hypothesis  that  the  longer 
an  officer  is  at  his  job,  the  better  are  his  chances  for  a 
top  rating. 
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LEVEL  OF  ASSIGNMENT  (i,e.,  Squadron,  Wing,  ?1AJC0M)  influences 


i 

the  rating 

an  individual  rec 

eives 

* 

F 

£ 

l 

r 

Category 

No.  of  Respondent 

s 

Mean 

Prob. 

- 

i 

l's 

193 

OLD 

4.9585 

NEW 

5.4663 

.000 

g 

\ 

2 ' s 

126 

OLD 

5.0635 

NEW 

5.4762 

.024 

? 

i. 

3's 

66 

OLD 

5.0758 

NEW 

5.5758 

.055 

: 

r 

t 

No  Score 

127 

OLD 

5.4331 

NEW 

5.5748 

.414 

i 

[ 

Total 

387 

OLD 

5.0468 

NEW 

5.5245 

.000 

In  the  LEVEL  OF  ASSIGNMENT  factor  three  out  of  the  five 
categories  show  a significant  shift  in  means.  Tne  No  Score 
and  3‘s  categories  did  not  reflect  a significant  shift. 

The  total  category  which  includes  a larger  sample  of 
3's  shows  a significant  shift.  The  shift  in  means  of  the 
No  Score  category  is  most  likely  explained  by  chance. 

The  perception  is  that  LEVEL  OF  ASSIGNMENT  is  more  influ- 
ential under  the  new  OER  system  than  under  the  old  OER  system. 
The  perception  is  most  probably,  that  officers  at  higher 
levels  of  assignment  will  more  likely  do  better  in  ratings 
than  officers  at  lower  levels . The  controlled  distribution 
of  ratings  applies  to  each  individual  reviewer.  Therefore, 
for  this  perception  to  occur  in  practice,  the  reviewer  would 
have  to  rate  individuals  at  different  levels  of  assignment. 
This  would  occur  at  a typical  base  where  the  wing  commander 
is  normally  the  reviewing  official  and  rater  for  both 
squadron  and  wing  level  officers. 
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There  may  exist  some  sound  basis  for  the  perception,  in 
that  the  officers  at  higher  LEVELS  Of  ASSIGNMENT  have  been 
selectively  chosen  for  those  positions.  This  is  the  same 
reasoning  that  promotion  boards  use  in  compensating  officers 
with  a 2 or  3 rating  from  SPECATS  when  SPECAT  officers  face 
promotion.  The  subjective  compensating  that  takes  place  may. 
have  both  positive  and  negative  aspects. 

The  perception  that  LEVEL  OF  ASSIGNMENTS  influences  the 
rating  an  officer  receives  is  very  important.  Assuming  the 
majority  of  junior  officers  occupy  positions  at  the  lower 
levels  of  assignment  then  the  favorable  influence  is 
reserved  for  the  minority  of  officers.  The  line  officer  at 
the  squadron  level  may  feel  that  he  has  little  chance  of  his 
potential  being  fairly  considered  against  an  officer  working 
at  the  wing  level.  As  long  as  the  line  officer  perceives 
the  possibility  of  moving  into  the  higher  LEVEL  OF 
ASSIGNMENT  and  attaining  the  same  favorable  influence  received 
by  those  officers  already  there,  then  perhaps  the  perception 
has  balancing  aspects. 
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The  RELATIONSHIP  BETWEEN  RATING  OFFICIALS  influences  the 
rating  an  individual  receives. 


Category 

No.  of  Respondents 

Mean 

Prob. 

l's 

193 

OLD 

5.0052 

NEW 

5.6218 

.000 

2's 

126 

OLD 

5.0000 

NEW 

5.8254 

.000 

3 ' s 

66 

OLD 

5.0606 

NEW 

6.1970 

.000 

No  Score 

127 

OLD 

5.1811 

NEW 

5.7165 

.000 

Total 

387 

OLD 

5.0318 

New 

5.9692 

.000 

All  five  categories  showed  a significant  shift  in  the 
means  of  the  RELATIONSHIP  BETWEEN  RATING  OFFICIALS  factor. 

The  perception  that  the  relationship  between  the  officers 
who  rate  an  officer  is  influential  in  determining  the  rating 
an  individual  receives  is  very  important.  Assuming  that  the 
individual  receiving  the  rating  has  little  control  of  the 
relationship  that  exists  between  the  evaluators  this  factor 
becomes  a perception  that  the  junior  officer  has  little 
control  over.  If  the  relationship  is  harmonious,  the  officer 
may  receive  a fair  or  favorable  rating,  however,  if  the 
relationship  is  not  harmonious,  the  officer  may  receive  an 
unfair  or  unfavorable  rating. 

For  example,  if  the  rater  is  thought  to  be  fair, 
equitable  and  objective  in  both  his  work  and  ratings,  then 
the  additional  rater  and  reviewer  may  view  the  ratings  the 
rater  assigns  with  a great  deal  of  competence.  If,  on  the 
other  hand,  the  rater  is  thought  to  be  lacking  in  the  ratings 
or  the  work  he  does,  then  the  addi. onal  rater 


he  assigns. 
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and  reviewer  may  attach  little  credibility  to  his  ratings. 

Regardless  of  the  relationship  that  exists  between  the 
rating  officials,  junior  officers  perceive  the  relationship 
as  having  more  influence  under  the  new  OER  system  than  under 
the  old.  As  long  as  the  junior  officer  has  no  control  over 
this  factor  of  relationship,  he  is  subject  to  whatever 
relationship  that  may  exist.  In  addition,  or  as  part  of 
the  relationship,  is  the  fact  that  rater  and  additional  rater 
are  being  encouraged  to  comply  with  the  22-28-50  distribution 
of  ratings.  As  to  what,  impact  this  may  have  on  the  different 
types  of  relationships  that  may  exist  is  left  to  the  reader.  A 
logical  conclusion  is  that  those  junior  officers,  who  perceive 
they  are  being  rated  where  an  unfavorable  relationship  exists, 
are  likely  to  think  that  they  will  receive  unfair  considera- 
tion while  those  who  perceive  an  unbiased  relationship  will 
receive  fair  consideration. 
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RATED  VERSUS  NON-RATED  influences  the  rating  an  individual 
receives . 


Category 

No.  of  Respondents 

Mean 

Prob . 

l’s 

193 

OLD 

4.0207 

NEW 

4.6062 

.000 

2’s 

126 

OLD 

4.1667 

NEW 

4.8571 

.000 

3 ’ s 

66 

OLD 

3.9697 

NEW 

4.6212 

.007 

No  Score 

127 

OLD 

4.4252 

NEW 

4.7008 

.040 

Total 

387 

OLD 

4.0350 

NEW 

4.6828 

.000 

The  RATED  VERSUS  NON-RATED  factor  showed  a significant 
shift  in  means  for  all  five  categories.  The  perception  that 
rated  officers  do  better  than  non-rated  is  probably  one  of  the 
oldest  perceptions  in  the  Air  Force.  The  perception  exists 
that  RATED  VERSUS  NON-RATED  factor  is  more  influential  under 
the  new  OER  system  than  under  the  old  OER  system.  The 
perception  has  as  a basis,  the  idea  that  the  job  of  the  Air 
Force  is  to  fly  and  officers  who  are  not  rated  are  around  to 
assist  in  getting  the  flying  done.  This  perception  has  gained 
in  importance  under  the  new  OER  as  a factor  influencing  the 
rating  an  individual  receives. 

The  perception  leads  the  rated  officer  to  believe  he 
has  an  edge  over  the  non-rated  officer,  while  the  non-rated 
officer  believes  he  is  at  a disadvantage  when  compared  to  the 
rated  officer.  The  implementation  of  the  rated  supplement 
program  may  have  been  a step  toward  dispelling  this  per- 
ception. however,  the  perception  still  exists  at  the  present 

f-  i ' 
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The  perception  is  normally  found  in  one  of  tv/o  situations. 
First,  the  situation  at  a typical  flying  base  where  the 
majority  of  officers  are  rated.  Here,  the  non-rated  officers 
perceive  that  the  rated  officers  will  get  the  higher  ratings 
due  to  the  very  mission  of  the  base  and  also  the  key  positions 
of  command  (evaluators)  are  normally  occupied  by  rated 
officers.  Second,  the  situation  at  a typical  non-flying 
base  where  the  majority  of  the  officers  are  non-rated.  Here, 
the  rated  officer  perceives  that  due  to  the  control  and 
mission  of  the  base  being  non-flying  oriented,  the  non-rated 
officer  will  get  the  higher  ratings.  If  either  side  of  the 
perception  prevails,  it  depends  on  which  viewpoint  is  in  the 
majority,  rated  or  non-rated. 

Even  within  the  category  of  rated  officers , there  exists 
mixed  emotions  concerning  the  pilot  versus  navigator  per- 
ceptions. The  available  data  shows  that  navigators  do  not 
receive  as  many  top  ratings  as  support  personnel.  The 
support  officers  do  not  do  as  well  as  the  officers  who  are 
pilots  (Ref  9) . 
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In  the  opinion  of  the  author,  this  data  (Ref  9) 
supports  the  perception  that  differences  between  the  rated 
and  non-rated  officers  are  influencing  the  OCRs  officers 
receive.  In  no  case  did  the  navigators  attain  the  prescribed 
22-28  distribution.  The  author  does  not  attach  much 
significance  to  the  small  differences  between  the  support 
and  pilot  categories. 

No  one  can  expect  any  rating  system  to  be  perfect. 

Had  the  data  been  presented  with  the  navigators  included 

» 

with  the  pilots,  the  differences  would  have  been  much  smaller 
The  Air  Force  Times  presented  some  statistics  showing  that 
officers  with  logistics  specialties  did  better  percentage- 
wise, than  pilots,  in  receiving  both  top  block  and  top  two 
block  ratings.  The  logistics  officers  received  25.6  percent 
top  block  while  the  pilots  received  24.9  percent  top  block 
and  55.7  percent  to  54.5  percent  top  two  block  respectively 
(Ref  5:17).  Thus,  one  has  seen  that  if  differences  are 
small,  data  can  be  obtained  to  support  opposing  viewpoints. 

The  previous  factors  were  discussed  individually,  due  to 
the  fact  that  a considerable  amount  of  controversy  exists 
among  different  groups  of  junior  officers  concerning  the 
fore-mentioned  factors.  For  example,  the  RATED  VERSUS 
NON- RATED  factor  is  a point  of  controversy  between  rated  and 
r.on-ratcd  officers.  The  remaining  factors  appears  to  have 
ci  more  common  basis  for  a perception  and,  therefore,  the 
junior  officers  as  a group,  show  the  same  perception.  This 
is  net  to  sav  the  re^ainino  factors  arc  less  influential 
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but  only  that  there  exists  less  controversy  about  the 
remaining  factors. 

OTHER  FACTORS 

PHYSICAL  APPEARANCE  influences  the  rating  an  individual 
receives . 

EDUCATIONAL  LEVEL  influences  the  rating  an  individual 
receives. 

SOURCE  OF  COMMISSION  influences  the  rating  an  individual 
receives . 

ADDITIONAL  DUTIES  influences  the  rating  an  individual 
receives . 

PROFESSIONAL,  MILITARY  EDUCATION  (PME)  influences  the  rating 
an  individual  receives. 

JOB  PERFORMANCE  influences  the  rating  an  individual  receives. 

DIVERSITY  OF  PRIOR  ASSIGNMENTS  influences  the  rating  an 
individual  receives. 

A NON- JOB  RELATED  MISFORTUNE  (i.e. , speeding  ticket) 
influences  the  rating  an  individual  receives. 

JOB  STATUS  (i.e..  Instructor  Pilot  versus  Line  Pilot) 
influences  the  rating  an  individual  receives. 

Of  the  nine  remaining  factors  listed  above,  all  of  them, 
in  nearly  every  category,  showed  a significant  shift  in  the 
means.  The  result  of  the  shift  was  that  the  nine  factors 
increased  in  influence  under  the  new  OER.  Of  the  total  18 
factors,  17  followed  the  trend  of  increased  influence  under 
the  new  OER.  Due  to  the  necessity  for  the  evaluators  to 
discriminate  among  officers  in  order  to  assign  ratings 
(because  of  the  new  OER  controlled  distribution) , it  is  not 
surprising  to  see  almost  every  factor  increase  in  influence. 


52 


-in};*'**.--'? 


GSM/SM/76D-3? 

By  using  the  neutral/no  opinion  answer  as  a basis  of 
reference,  some  of  the  above  factors  are  perceived  to  have 
a great  deal  of  influence  while  others  have  relatively  very 
little  influence. 

MEAN  RANK  ORDERING 


E 


f 

£ 


! 

i 
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Some  interesting  results  occur  if  the  eighteen  factors 
are  rank  ordered  by  their  respective  means  with  respect  to 
the  TOTAL  category  (Refer  Table  II) . The  results  of  this 
ranking  cannot,  and  should  not  be  interpreted  as  a relative 
rank  ordering  of  the  importance  of  each  factor  for  several 
reasons.  First,  due  to  the  fact  that  the  respondent  was 
presented  one  factor  at  a time,  he  was  not  necessarily 
comparing  that  factor  to  any  of  the  other  factors.  Second,  the 
seven  point  answer  scale  may  have  played  a role  by  distorting 
the  answers  in  a relative  sense.  For  example,  if  an  officer 
wanted  to  show  a large  difference  in  the  influence  of 
VISIBILITY  between  the  old  and  new  system,  he  may  have  marked 
a strongly  disagree  for  the  old  system  visibility  and  a 
strongly  agree  for  the  new  system  visibility.  Having  done 
this,  the  same  officer  could  still  perceive  old  system 
visibility  to  be  much  more  influential  than  some  other  old 
factors  he  may  have  marked  above  the  strongly  disagree  point. 
The  end  of  the  scale  does  not  necessarily  mean  a low/high 
amount  of  influence.  The  rank  ordering  of  means  in  Table  II 
does,  however,  present  a better  idea  of  the  relative  shift 
in  means. 
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Table  II 

Rank  Ordering  of  Means 
TOTAL  CATEGORY 
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Section  II 


INTRODUCTION 


This  section  will  deal  with  the  question  that  asked 
the  respondent  to  list  the  five  factors  he  considered  most 


important  in 

influencing  the  rating  an  individual  receives 

The  officers 

surveyed  were  asked  to  list  their  choices  in 

descending  order. 

1) 

Physical  Appearance 

2) 

Upcoming  PCS 

3) 

Length  of  Time  in  a Job 

4) 

Educational  Level 

5) 

Special  Assignments 

6) 

Source  of  Commission 

7) 

Add  ' . - ->nal  Duties 

8) 

Pr  - :ional  Military  Education 

9) 

Rated  Versus  Non-Rated 

10) 

Job  Performance 

ID 

Diversity  of  Prior  Assignments 

12) 

Established  DOS 

13) 

Primary  Zone  for  Promotion 

14) 

Non-Job  Related  Misfortune 

15) 

Visibility 

16) 

Relationship  between  Rating  Officials 

17) 

Level  of  Assignment 

18) 

Job  Status 

-i— ^ i 
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48.  List  the  five  factors  you  consider  MOST  important 

in  influencing  the  rating  an  individual  receives. 

(List  in  decreasing  importance) 

NEW  OER  SYSTEM  1 

2  

3 

4 

5 

The  results  from  each  category  will  be  presented  in 
two  different  ways.  One  section  will  show  the  data 
gathered  by  looking  at  only  the  answers  for  the  first  most 
important  factor  and  the  second  section  will  show  the  data 
gathered  by  considering  all  five  choices  with  each  choice 
weighted  equally. 

For  example,  the  TOTAL  category  data  (Ref  Table 
III-VII)  represents  the  responses  of  over  four  hundred  officers. 
The  first  column  represents  the  choices  the  officers  made 
for  the  most  important  factor.  The  second  column  represents 
the  cumulative  total  of  the  choices  the  officers  made  for 
the  five  most  important  factors.  The  total  of  the  responses 
does  not  add  to  405,  nor  does  the  percentages  add  to  100 
due  to  some  officers  leaving  some  choices  blank.  The  same 
explanation  of  the  results  of  the  data  apply  to  all  other 
categories . 


OLD  OER  SYSTEM  1 
2 

3 

4 

5 
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JOB  PERFORMANCE 


The  figures  :n  the  first  column  (Ref  Table  III)  show 
the  changes  in  what  officers  consider  the  first  most  impor- 
tant factor  in  influencing  the  OER  an  individual  receives. 
While  JOB  PERFORMANCE  is  obviously  the  most  important  factor 
under  both  the  old  and  new  OER  systems,  two  other  ramifica- 
tions of  the  data  must  be  kept  in  mind.  First,  approximately 
33%  of  the  officers  under  the  old  OER  system  and  465?  of  the 
officers  under  the  new  OER  system  selected  some  other  factor 
as  being  most  influential.  Second,  had  JOB  PERFORMANCE  not 
been  a viable  choice  by  being  excluded  from  the  list  of 
factors,  the  numbers  associated  with  the  other  factors  would 
have  been  of  larger  magnitude.  The  numbers  in  the  second 
column  will  help  clarify  and  enlarge  on  the  data  in  the 
first  column. 

While  JOB  PERFORMANCE  was  considered  the  most  important 
factor  in  both  OER  systems , it  did  take  a significant  drop 
in  the  number  of  officers  who  consider  it  most  important. 

A possible  explanation  as  to  the  relative  drop  in  importance 
of  JOB  PERFORMANCE  might  be  the  idea  that  under  the  old 
OER  system  JOB  PERFORMANCE  was  thought  to  be  a necessary 
and  sufficient  factor  in  order  to  receive  a top  rating, 
while  under  the  new  OER  system  JOB  PERFORMANCE  is  a 
necessary,  but  not  sufficient,  .actor  in  order  to  receive 
a top  rating.  If  this  explanation  of  the  relative  drop 
in  influence  of  JOB  PERFORMANCE  is  true,  then  the  increase 
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in  influence  of  other  factors  is  a natural  corollary. 
Disregarding  the  relative  drop  in  influence,  the  fact  that 
in  all  categories  and  cases  JOB  PERFORMANCE  is  considered 
the  most  important  factor  in  influencing  the  rating  an 
individual  receives  is  worthy  of  much  consideration. 

Most  officers  believe  that  their  entire  OER  can  be 
summed  up  in  one  number,  the  rating  given  by  the  reviewing 
official.  The  rating  the  reviewer  assigns  is  a measure 
of  the  "potential"  the  officer  possesses.  Therefore,  the 
vast  majority  of  junior  officers  feel  that  JOB  PERFORMANCE 
is  the  most  important  factor  making  up  their  potential. 

An  interesting  facet  of  this  perception  is  that  the  front 
side  of  the  new  OER  form  contains  a section  for  evaluating 
JOB  PERFORMANCE,  while  the  back  side  of  the  form  contains 
the  section  for  evaluating  the  potential  of  an  officer. 

The  logical  consequence  is  that  while  JOB  PERFORMANCE  is 
directly  evaluated  on  the  front  of  the  form,  junior 
officers  perceive  the  potential  section  on  the  back  to  also 
be  some  reflection  of  their  JOB  PERFORMANCE.  As  to  whether 
or  not  JOB  PERFORMANCE  can  be  the  prime  measure  of  potential 
is  open  for  debate. 

PRIMARY  ZONE  FOR  PROMOTION 

The  factor  making  the  most  dramatic  shifts  was  PRIMARY 
ZONE.  Under  the  old  OER  system,  PRIMARY  ZONE,  along  with 
several  other  factors,  was  relatively  uninf luential.  Under 
the  new  OER  system,  PRIMARY  ZONE  was  consistently  ranked 
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as  either  the  second  or  third  most  important  factor  in 
almost  all  categories  and  cases. 

The  fact  that  the  perception  of  PRIMARY  ZONE  being  the 
second  or  third  most  important  factor  in  most  categories 
and  cases,  lends  more  credibility  to  the  significant  shift 
in  means  discussed  in  Section  I of  this  chapter.  Also,  the 
fact  that  this  perception  is  consistent  among  the  different 
categories  of  officers  and  is  held  by  the  majority  of 
officers  in  each  category  suggests  that  the  perception  is  a 
common  perception  held  by  all  junior  officers.  In  almost 
every  area  of  analysis  in  this  research  effort  the  data  and 
results  were  very  consistent,  regardless  of  the  group  that 
was  broken-out.  This  consistency  suggests  that  the  percep- 
tions are  widespread  among  all  junior  officers. 

VISIBILITY 


As  discussed  earlier  in  this  chapter,  VISIBILITY  can 
eminate  from  many  different  sources  and  have  either  positive 
or  negative  aspects.  Trying  to  define  what  VISIBILITY  is, 
or  consists  of,  may  be  an  arduous,  if  not  impossible,  task. 
However,  this  research  effort  has  shown  that  junior  officers 
perceive  VISIBILITY  to  have  increased  significantly  in 
influencing  the  OER  an  individual  receives  under  the  new 
OER  system.  (Ref  Table  VIII) . In  most  instances  VISIBILITY 
was  selected  as  the  second  most  important  factor  under  the 
new  OER  system,  while  under  the  old  OER  system,  it  was 
relatively  unimportant. 
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Table  VIII 

Factors  Changing  Importance 
Under  New  OER  System 
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INCREASED 

Visibility 

Primary  Zone  for  Promotion 
Length  of  Time  in  a Job 
Relationship  Between  Rating 
Officials 
Established  DOS 
Rated  vs.  Non-Rated 
Upcoming  PCS 


DECREASED 
Job  Performance 
Additional  Duties 
Level  of  Assignment 
Job  Status 
PME 

Educational  Level 

Special  Assignments 

Non- Job  Related  Misfortune 

Physical  Appearance 

Diversity  of  Prior  Assignments 

Source  of  Commission 
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Part  of  the  explanation  of  the  increased  importance 
of  VISIBILITY  may  lie  in  the  fact  that  the  ratings  (under 
the  new  OER  system)  are  under  a controlled  distribution. 

Under  the  new  system  only  the  reviewing  official  is  forced 
to  meet  the  controlled  distribution.  As  a result,  junior 
officers  feel  that  the  rating  the  reviewer  assigns  is  the 
most  important.  Coupling  this  importance  with  the  normal 
situation  of  the  reviewing  official  being  at  least  three 
steps  up  the  individual's  chain-of-command,  the  VISIBILITY 
the  junior  officer  has  with  the  reviewer  is  of  major  concern. 
Most  officers  feel  that  the  farther  up  the  chain-of-command 
a rating  goes,  the  less  direct  knowledge  the  man  at  the  top 
can  possess  of  the  individual  being  rated.  Whatever 
owledge  VISIBILITY  can  offer  the  reviewing  official  is 
certainly  thought  to  be  influential  by  the  ratee. 

Since  junior  officers  perceive  VISIBILITY  to  be  very 
influential  the  amount  and  type  of  VISIBILITY  they  have 
must  be  very  important  to  them  also.  In  that  VISIBILITY  is 
very  hard  to  measure  and  most  officers  are  not  sure  what 
type  of  VISIBILITY  they  possess,  this  factor  even  though 
important,  is  very  hard  to  deal  with  or  interpret  for  each 
individual  officer.  Other  aspects  such  as  control  of 
VISIBILITY  and  opportunities  for  VISIBILITY  further  compound 
this  factor.  When  all  the  aspects  of  VISIBILITY  are 
considered  together  the  perception  remains  that  VISIBILITY 
is  the  second  most  important  factor  influencing  the  OER 
a.,  individual  officer  receives. 
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ADDITIONAL  DUTIES  G PME 


Under  the  old  OER  system  many  junior  officers  believed 
ADDITIONAL  DUTIES  were  very  influential  in  determining  the 
OER  an  individual  received.  Under  the  new  OER  system, 
while  this  viewpoint  is  still  held  by  many  officers,  there 
has  been  a relative  drop  in  importance.  The  drop  could  be 
explained  by  two  reasons.  Under  the  old  system,  a common 
perception  was  that  in  order  to  assure  a top  rating,  an 
individual  had  to  have  some  ADDITIONAL  DUTIES  to  put  on 
his  OER,  even  if  they  were  meaningless  or  trivial.  Under 
the  new  OER,  junior  officers  feel  that  this  "sqi  tiling” 

is  no  longer  beneficial  if  the  additional  duty  is  not  of 
substance.  Other  officers  may  be  of  the  opinion  that 
ADDITIONAL  DUTIES  are  part  of  the  whole  man  the  rating 
officials  are  trying  to  evaluate  and  are  not  in  and  of 
themselves  that  important. 

Along  these  same  lines  of  reasoning  may  lie  the 
explanation  for  the  drop  in  importance  of  PROFESSIONAL 
MILITARY  EDUCATION.  Under  the  old  OER  system,  PME  was  often 
the  focus  of  many  complaints  when  square  filling  was  the 
topic  under  discussion.  That  fact  that  the  sample,  which 
was  the  basis  for  the  data  showing  this  drop,  consisted 
entirely  of  officers  attending  a PME  school  is  interesting 
itself.  If  this  factor  were  to  have  gained  in  influence, 
sure.ly  those  officers  spending  three  months  in  residence, 
to  complete  the5  course,  would  have  reflected  this  change. 
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ESTABLISHED  DOS 

The  increase  in  importance  of  an  ESTABLISHED  DOS  may 
be  best  explained  by  the  perception  that  officers  with  an 
ESTABLISHED  DOS  will  be  used  to  fill  in  the  lower  ratings 
quota.  This  perception  is  one  type  of  gaming  the  system 
in  that  those  officers  intending  to  separate  from  the  Air 
Force,  by  being  given  lower  ratings,  are  giving  those 
officers  remaining  in  the  service  a better  chance  of 
receiving  a higher  rating.  In  view  of  the  fact  that  an 
officer  with  an  ESTABLISHED  DOS  is  in  essence  demonstrating 
little  potential  the  system  is  actually  just  assigning  him  a 
rating  matching  his  potential  and,  therefore,  maybe  there  is 
no  gaming  taking  place  at  all. 

RELATIONSHIP  BETWEEN  PsATING  OFFICIALS 

Under  tne  old  OEP.  system,  the  common  practice  was  to 
have  an  officer's  OEF.  enter  a petitioning  process  for 
additional  endorsements.  In  this  process  an  OER  was  passed 
up  to  high  ranking  officers  for  an  additional  endorsement 
in  the  hope  that  the  endorsements  would  be  looked  on  favor- 
ably bv  promotion  boards.  A common  occurrence  was  for  an 
officer  to  have  his  OEP  endorsed  by  some  general  officer 
with  whom  he  had  little  contact  or  knowledge,  however,  a 
rubber  stamp  endorsement  was  thought  to  be  better  than  no 
endorsement . '"'he  system  was  a self-perpetuating  process, 

in  that,  no  one  wanted  to  Lake  the  chance  of  not  having  the 
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additional  endorsements . 

The  new  OER  system  limited  the  number  of  officers 
that  could  evaluate  an  OER  to  three.  The  result  was  an 
elimination  of  the  petitioning  process.  With  the  limit  of 
only  three  evaluators,  the  relationship  that  exists  among 
these  officers  has  gained  in  importance.  The  limiting 
process  also  normally  keeps  the  evaluators  at  a level 
where  the  evaluators  are  more  likely  to  have  some  direct 
knowledge  of  the  officer  being  evaluated.  Also,  by  having 
only  three  evaluations,  judgements  expressed  in  the  OER 
by  the  evaluators  the  promotion  board  is  limited  in  the 
information  available  and  therefore,  increased  emphasis 
must  be  placed  on  the  evaluations  the  board  has. 

Junior  officers  perceive  that  due  to  the  nature  of 
distribution  of  scores  and  the  limit  of  three  evaluators, 
the  relationship  that  exists  among  the  evaluators  must  be 
of  increased  importance.  The  author  feels  that  an  officer 
believes  part  of  his  chances  for  a higher  rating  rest  on 
the  relationship  that  exists  among  his  rating  officials . 
For  example,  if  an  individual  has  a rater  who  he  feels  is 
not  held  in  high  regard  by  the  higher  level  evaluators, 
he  may  feel  that  his  chance  of  receiving  a top  score  are 
limited  by  his  rater  and  not  by  his  own  potential. 
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Section  III 


Introduction 

In  the  two  previous  sections,  the  author  was  dealing 
with  perceptual  differences  between  the  old  and  new  OER 
systems.  In  this  section,  the  author  will  address  a few 
of  the  issues  unique  to  the  new  OER  system.  At  the  heart  of 
the  new  system  is  the  controlled  distribution  of  scores. 

The  distribution  allows  only  22  percent  of  the  officers 
within  each  grade  to  receive  a top  block  rating.  During  the 
last  years  of  the  old  system,  nearly  90  percent  of  all 
officers  received  a top  rating.  Because  so  many  officers 
received  a top  rating  under  the  old  system,  the  OER  was 
not  considered  by  most  officers  to  be  a decisive  factor  in 
their  career  of  promotion  opportunities.  Under  the  new 
system,  the  OER  has  become  a decisive  factor  in  the  career 
and  promotion  opportunities  of  an  officer. 

Data  Presentation 

In  questions  49,  50,  and  51,  presented  in  the  following 
pages,  the  answers  will  be  grouped  into  three  categories. 

All  responses  left  of  Neutral  will  be  combined  into  a Dis- 
agree segment.  All  responses  right  of  Neutral  will  be 
combined  into  an  Agree  segment.  The  Neutral/No  Opinion 
segment  will  consist  only  of  the  respondents  who  actually 
chose  the  mid-point  answer. 
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Question  49  and  the  following  question  (50)  were  intend- 
ed to  be  follow-on  questions  to  the  Carr  and  Rhoades  study. 

The  author,  however,  did  not  duplicate  the  questions  or 
answers  for  two  reasons.  First,  the  questions  were  not 
duplicated  because  of  good  questionnaire  policy.  In  order 
to  draw  comparisons  between  two  questions,  the  stems  should 
be  the  same  and  only  the  stimuli  should  vary.  For  example, 
questions  49  and  50  are  identical,  except  for  the  first 
word.  The  first  word  is  the  stimuli,  the  rest  of  the 
question  is  the  stem.  Carr  and  Rhoades  changed  both  the 
stimuli  and  stem  in  the  questions  corresponding  to  48  and  49 
in  this  study.  The  other  reason  the  author  did  not  duplicate 
the  questions  of  Carr  and  Rhoades,  deals  with  the  answers  to 
the  questions.  In  the  Carr  study,  many  of  the  questions 
had  a high  percentage  of  Neutral/No  Opinion  answers.  The 
author  agreed  with  Carr,  in  that  part  of  the  explanation  was 
that  the  OER  was  relatively  new  at  the  time  (Nov-Dec  74)  and 
many  officers  had  not  formed  opinions.  The  author  also  felt 
that  the  use  of  a five  point  answer  scale  may  have  contribut- 
ed to  the  number  of  Neutral/No  Opinion  responses.  The  author 
in  this  survey  used  a seven  point  answer  scale  to  afford 
alternatives  of  answers.  As  a result  of  the  differences,  the 
author  cautions  the  reader,  when  comparing  the  Carr  results 
with  the  results  here,  from  drawing  any  hard  conclusions. 

Another  factor  must  be  considered  when  drawing  any 
comparisons  among  the  Carr,  Rhoades,  and  author's  data. 

Neither  Carr,  nor  Rhoades,  attempted  to  correct  their  data 
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for  the  selectivity  of  the  officers  in  their  samples.  The 
author  attempted  to  correct  for  the  disproportionate  share  of 
top  block  OER  scores  with  his  TOTAL  category.  The  TOTAL 
category  as  used  throughout  this  report  represents  a 
weighting  of  respondents  to  better  represent  the  Air  Force- 
wide distribution  (22-28-50)  of  OER  scores.  However,  in  the 
following  two  instances , where  the  author  includes  his 
results  with  those  of  Carr  and  Rhoades , the  author  will  use 
the  same  techniques  and  procedures  as  did  Carr  and  Rhoades. 
The  author  will  do  this  in  only  the  two  instances , so  that 
the  reader  can  more  easily  draw  comparisons. 


THE  RATER 

49.  RATING  officials  are  generally  qualified  to  recommend 
who  should  receive  the  top  two  scores. 


1 2 

3 

4 5 

6 7 

Strongly 

Disagree 

Neutral/ 
No  Opinion 

Strongly 

Agree 

Agree 

Neutral/ 
No  Opinion 

Disagree 

{%) 

(%) 

(%) 

l's 

84.2 

5.9 

9.9 

2's 

82.8 

4.5 

12.7 

3 ' s 

72.1 

8.8 

19.1 

No  Score 

77.1 

8.4 

14.5 

Total 

77.7 

7.0 

15.3 
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The  clear  majority  of  respondents  in  every  category  feel 
the  rating  official  qualified  to  assign  the  top  two  ratings. 

As  could  be  expected,  the  higher  the  rating  an  officer 
received,  the  more  agreement  as  to  the  rater  being  qualified. 
RATER  QUALIFIED 


Agree 

(55) 

Neutral/ 
No  Opinion 

(55) 

Disagree 

(55) 

Carr 

63.4 

12.5 

22.8 

Rhoades 

68.7 

12.5 

18.8 

Author 

80.6 

6.5 

12.9 

(Ref  14:35,  3:47) 

The  author  feels  that  the  changes  in  the  percentage 
of  respondents  would  not  have  been  as  large  had  he  used  the 
question  and  answers  used  by  Carr  and  Rhoades.  With  this 
in  mind,  the  increasing  trend  for  officer  to  perceive  the 
rater  as  being  qualified  to  recommend  the  top  two  ratings 
continues . 

THE  REVIEWER 

50.  REVIEWING  officials  are  generally  qualified  to  recommend 
who  should  receive  the  top  two  scores. 


Agree 

Neutral/ 
No  Opinion 

Disagree 

(55) 

(55) 

(55) 

l‘s 

61.4 

8.4 

30.2 

2 ' s 

52.2 

8.2 

39.6 

3 * s 

45.6 

8.8 

45.6 

No  Score 

48.8 

13.0 

38.2 

Total 

50.9 

8.6 

40.5 
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As  far  as  the  reviewer  being  qualified  to  recommend 
top  block  ratings/  chere  exists  significant  differences 
among  the  fi\..  categories.  Of  the  officers  with  OER  ratings, 
the  differences  can  be  explained  by  a natural  phenomenon. 

The  officers  with  top  ratings  see  the  reviewer  as  qualified, 
while  the  officers  with  low  ratings  tend  to  see  the  reviewer 
as  being  unqualified. 

REVIEWER  QUALIFIED 

Neutral/ 


Agree 

No  Opinion 

Disagr 

(%) 

(55) 

(55) 

Carr 

38.5 

16.9 

43.9 

Rhoades 

36.5 

14.6 

48.9 

Author 

54.0 

9.6 

36.4 

(Ref  13:52,  3:48) 

The  increase  in  the  percentage  of  officers  agreeing 
that  the  reviewer  is  qualified  to  recommend  ratings  may  be 
caused  by  the  wording  the  author  used  in  his  question.  The 
previous  two  studies  ask  the  respondent  if  the  reviewer  was 
qualified  to  "decide",  while  the  author  asked  if  the 
reviewer  was  qualified  to  "recommend".  In  actual  practice, 
the  reviewer  decides  the  ratings  officers  receive.  The 
reader  should  keep  in  mind  that  in  the  above  figures  of  the 
author,  no  correction  is  included  for  the  disproportionate 
share  of  high  OER  scores  and  the  high  career  motivation  cf 
the  officers  in  the  sample. 
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FORCED  DISTRIBUTION 

51.  The  distribution  of  scores  is  being  FORCED  downhill. 

Neutral/ 


Agree 

No  Opinion 

Disagree 

(36) 

(%) 

(*> 

l's 

72.1 

20.4 

7.5 

2's 

82.9 

9.3 

7.8 

3's 

85.3 

10.3 

4.4 

No  Score 

75.3 

18.5 

6.2 

Total 

81.7 

12.3 

6.0 

The  Air  Force  regulation  (AFR  36-10)  covering  the  OER 
prohibits  any  evaluator  in  the  OER  process  from  forcing  any 
lower  rating  officials  to  meet  a distribution.  The  review- 
ing official  can  be  directed  « o meet  the  prescribed 
distribution;  should  he  not  meet  the  22-28-50  distribution 
(Ref  1).  The  reviewing  official  doe?  have  several  options 
available.  The  reviewer  can:  (1)  provide  guidelines  that 

will  assist  in  the  reviewing  process;  (2)  require  that  OER's 
have  ratings  tnat  are  fully  substantiated;  (3)  ask  the 
raters  to  provide  a list  with  the  ratees  prioritized;  (4) 
convene  a board  to  consider  the  distribution  of  ratines 
(Ref  4:8).  Although  no  formal  forcing  is  permitted,  'he 
rater  and  additional  rater  realize  that  the  OER's  they  send 
to  the  reviewer  will  be  forced  to  fit  the  distribution.  In 
regards  to  meeting  the  distribution,  evaluators  have  been 
told  by  some  individuals  that  their  attempt  co  meet  the 
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distribution  reflects  directly  on  the  evaluators  themselves 
(Ref  13:2)  . 

The  forcing  of  the  distribution  downhill  may  have 
several  results.  The  rater  may  perceive  himself  in  a gaming 
situation.  The  rater  may  make  his  evaluations  on  what  he 
thinks  will  be  acceptable  to  the  additional  rater,  and/or, 
reviewer.  For  example,  the  rater  may  feel  that  two  of  his 
five  officers  rate  a top-block  score,  but  he  may  think 
that  he  can  only  hope  to  get  one  top-block  score  accepted 
by  the  higher  level  evaluators.  Another  result  is  that 
the  rater  will  be  forced  to  make  a more  discerning 
comparison.  The  rater  will  not  be  able  to  give  an  unwarrant 
ed  number  of  hich  scores. 

At  the  present  time,  due  to  the  rater  and  additional 
rater  not  meeting  the  prescribed  distribution,  the  reviewer 
has  only  two  choices.  The  reviewer  can  either  assign  the 
same  score  as  the  previous  evaluators,  or  lower  the  score. 

Of  the  405  OPR  scores  collected  by  the  author,  there  were 
only  2 instances  where  the  reviewer  score  was  higher  than 
the  rater's  score.  In  the  31  March  1975,  lieutenant  colonel 
OER  cycle,  only  37  of  approximately  4491  officers  received 
a "1"  or  "2"  from  the  reviewer  when  the  rater  had  assigned 
a "3"  previously  (Ref  5:17,  2:26).  Unless  the  situation 
changes  the  rater  is,  in  essence,  assigning  a maximum  score. 
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52.  An  officer's  performance  when  he  receives  a; 


Category  I rating  is 


A)  outstanding 

B)  above  average 

C)  average 

D)  below  average 

E)  marginal 

F)  not  evaluated 

G)  no  opinion 


Category  II  rating  is 


A)  outstanding 

B)  above  average 

C)  average 

D)  below  average 

E)  marginal 

F)  not  evaluated 

G)  no  opinion 

Category  III  rating  is 

A)  outstanding 

B)  above  average 

C)  average 

D)  below  average 

E)  marginal 

F)  not  evaluated 

G)  no  opinion 

Performance 

In  question  52,  the  respondee  had  to  select  the  alter- 
native that  best  described  his  perception  of  what  each  rating 
meant  in  terms  of  measuring  performance.  The  most  interesting 
aspects  were  the  percentages  of  officers  that  felt  a Category 
I rating  was  only  above  average  and  the  percentages  of 
officers  that  felt  a Category  III  rating  was  above  average 
(Table  IX).  The  "3's"  group  was  the  most  consistent.  The  3's 
tended  to  think  less  of  a Category  I rating  and  more  of  a 
Category  III  rating  than  the  other  groups.  Regardless  of 
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what  they  have  heard  or  read,  the  majority  of  officers 
perceive  a Category  III  rating  as  average. 


53.  An  officer's  promotion  probability  to  the  next  higher 
grade  if  he  receives  a: 

Category  I rating  is 


A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 


Category  II  rating  is 


A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 


Category  III  rating  is 

A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  iiv.  opinion 

PROMOTION  PROBABILITY 


The  results  of  the  data  from  question  53  are  very 
complicated  and  difficult  to  explain.  The  author’s  intent 
was  to  acquire  an  idea  of  how  promo  cable  do  junior  officers 
perceive  different  ratings  to  be.  The  author  can  only 
offer  his  general  impressions  of  the  data  (Table  X) . The 
majority  of  officers  feel  that  with  a I or  II,  the  prob- 
ability of  promotion  is  likely.  The  interpretation  of  the 
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perceptions  dealing  with  the  III  rating  is  more  complex. 

To  begin  with,  the  author  assumes  those  individuals 
who  selected  the  "Not  Affected"  answer,  feel  that  the  III 
rating  will  not  hinder  and/or  help  their  promotion  prob- 
ability. The  respondents  who  chose  "Not  Affected"  might 
feel  that  some  other  factor (s)  will  be  the  driving  or 
determining  force.  Of  the  other  responses,  there  are 
significantly  more  officers  who  view  a III  with  a less  like- 
liness of  promotion.  Approximately  75  percent  of  the 
officers  feel  that  with  a III,  their  chance  of  promotion  is 
less  than  likely.  The  reader  must  realize  that  about  80 
percent  of  the  respondees  are  captains  and  thus  are  reflect- 
ing their  perceptions  in  relation  to  a promotion  to  major. 

The  Air  Force,  in  numerous  instances,  has  stated  that 
a III  is  promotable  through  lieutenant  colonel,  this  view 
is  not  shared  by  the  officers  sampled  in  this  research 
effort.  The  author  was  unable  to  find  any  data  on  a promotion 
board  for  selection  to  major,  however,  data  from  a lieutenant 
colonel  board  was  available  and  will  be  presented  as  a means 
of  analyzing  the  data.  The  statistics  presented  below 
represent  the  results  of  the  first  temporary  lieutenant 
colonel  board  to  use  the  new  OER  (Ref  11:3) . 
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The  perception  that  a I or  II  has  a likely  probability 
of  promotion  was  verified  by  the  results  of  the  promotion 
board  selecting  temporary  lieutenant  colonels.  The 
perception  that  an  officer  with  a III  rating  not  being  very 
likely  to  be  promoted  also  appears  to  be  verified  by  the 
results.  First  time  eligible  officers  with  a I were  selected 
at  6 times  the  rate  of  officers  with  a III  and  officers  with  a 
II  at  5 times  the  rate  of  officers  with  a III. 


54.  The  ultimate  grade  an  officer  can  reach  if  he  primarily 
receives : 

Category  I rating  is 


A) 

General 

B) 

Colonel 

C) 

Lt  Colonel 

D) 

Major 

E) 

Captain 

F) 

No  Opinion 

Category  II  rating  is 


A) 

General 

B) 

Colonel 

C) 

Lt  Colonel 

D) 

Major 

E) 

Captain 

F) 

No  Opinion 

Category  III  rating  is 


A) 

General 

B) 

Colonel 

C) 

Lt  Colonel 

D) 

Major 

E) 

Captain 

F) 

No  Opinion 
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ULTIMATE  GRADE 

With  all  the  discussion  from  the  previous  question  in 
mind,  less  than  40  percent  of  the  junior  officers  feel  they 
can  be  promoted  above  the  rank  of  major  if  they  primarily 
(not  consistently)  receive  a Category  III  rating  (Table  XI) . 
The  ultimate  grade  achievable  with  a I or  II  rating  appears  to 
be  much  less  limited  than  that  of  a III  rating. 


55.  An  officer's  probability  of  achieving  an  AF  career  of  20 
years  if  he  primarily  receives : 

Category  I rating  is 

A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 

Category  II  rating  is 

A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 

Category  III  rating  is 

A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 
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CAREER  PROBABILITY 

Nearly  all  the  junior  officers  feel  that  a 20  year 
career  is  likely  with  a I or  II  rating.  The  perception  of 
the  probability  of  career  with  a III  rating  varies 
considerably,  depending  on  the  rating  the  individual 
presently  has.  The  officers  currently  having  a I are  much 
more  optimistic  about  career  probability  than  the  officers 
currently  having  a III  rating  (Table  XII) . The  Air  Force 
says  that  officers  will  get  a variety  of  ratings  as  time 
passes.  If  this  statement  is  true,  then  as  officers  receive 
the  different  ratings,  their  perception  of  their  career 
probability  may  change.  When  an  officer  has  a I rating, 
he  may  feel  a career  is  very  likely  and  when  he  receives  a III, 
he  may  feel  his  career  chances  are  very  low.  Perceptions 
on  career  probability  and  the  perceptions  discussed 
previously  in  this  chapter  have  led  to  the  conclusions  and 
recommendations  presented  in  the  following  chapter. 


TABLE  XII 

CAREER  PROBABILITY  VS.  RATINGS 
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CHAPTER  IV 

CONCLUSIONS  AND  RECOMMENDATIONS 

This  chapter  presents  the  most  significant  conclusions 
based  on  the  results  of  the  survey.  Under  the  old  system, 
good  job  performance  apparently  was  a necessary  and 
sufficient  basis  for  receiving  a top  rating.  Under  the  new 
system,  good  job  performance  is  a necessary,  but  not 
sufficient,  basis  for  receiving  a top  rating.  With  the 
evaluators  being  forced  to  discriminate  among  officers  in 
order  to  meet  the  prescribed  distribution  of  ratings,  more 
than  just  job  performance  is  being  considered.  The  idea 
of  the  whole-man  concept  is  being  put  into  practice  in  the 
OER  rating  system.  The  author  believes  this  is  evident 
from  the  fact  that  17  of  the  18  factors  investigated 
increased  significantly  in  influence  undi  . -he  new  OER 
system.  The  following  conclusions  and  recommendations 
are  the  result  of  junior  officer  perceptions  of  the  new 
OER  system. 


DOS : The  officers  with  an  established  DOS,  who 

do  not  qualify  for  an  abbreviated  OER,  are  being  used  to 
fill  in  the  lower  part  of  the  distribution.  While  the  low 
rating  may  or  may  not  be  an  accurate  reflection  of  the 
officer's  potential,  the  result  is  not  neccessarily 
beneficial.  The  conscientious  officer  who  receives  the 
same  rating  as  an  individual  with  an  established  DOS  is 
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not  likely  to  view  the  system  as  fair.  Also,  the  officer 
who  sees  others  receiving  a high  rating  due  to  the  presence 
of  officers  with  a DOS  will  hardly  see  the  system  as  being 
fair.  The  author  recommends  that  any  officer  with  a DOS, 
receive  an  abbreviated  OER. 

RATED  VERSUS  NON-RATED : Junior  officers  perceive 
that  certain  segments  of  the  Air  Force  receive  higher 
ratings  them  other  segments.  There  exists  data  to  support 
the  perception.  The  new  OER  system  was  never  thought,  nor 
intended,  to  be  perfect.  Some  of  the  imperfections,  such 
as  rated  officers  receiving  a slightly  higher  percentage 
of  the  top  rating,  than  do  support  personnel,  do  exist. 

The  magnitude  of  the  imperfection  is  probably  not  cause 
for  alarm,  but  by  either  ignoring  or  denying  the  imper- 
fection, more  harm  is  caused  than  that  created  by  the 
imperfection.  The  author  recommends  that  the  imperfections 
be  admitted  and  that  the  effects  of  such  minor  imperfections 
be  fully  explained.  The  Air  Force  junior  officer  is  not 
an  individual  from  whom  reality  must  be  hidden. 

VISIBILITY:  Visibility  is  a factor  that  cannot 

be  easily  defined  or  measured,  yet  junior  officers  feel 
that  it  is  very  influential  in  determining  the  rating  an 
individual  receives.  In  that  every  officer  cannot  come  in 
personal  contact  with  the  reviewing  official,  each  officer 
is  concerned  that  he  receive  some  visibility  with  the 
reviewer.  The  belief  that  officers  geographically  separated 
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from  their  reviewing  official  will  be  at  a disadvantage 
is  evidence  of  the  impact  of  visibility.  In  order  to 
assure  each  officer  some  visibility  every  reviewing  official 
should  use  a review  board  staffed  with  officers  who  know 
the  individuals  being  rated.  In  this  manner,  the 
opportunity  for  visibility  may  become,  more  equal  for  all 
concerned. 


JOB  PERFORMANCE ; Job  performance  is  still  a 
necessary,  but  no  longer  sufficient  factor  in  determining 
the  rating  an  individual  receives.  Apparently,  the  majority 
of  officers  believe  that  the  entire  OER  distills  into  one 
thing,  the  rating  the  reviewing  official  assigns.  That  one 
number  sums  up  the  entire  OER.  A natural  happening  then 
occurs.  Because  there  exists  no  criterion  for  the  potential 
or  explicit  definition,  the  officer  translates  the  score 
into  an  index  of  job  performance.  While  the  Air  Force  may 
not  intend  for  potential  to  be  equated  to  job  performance, 
it  happens.  Even  Air  Force  general  officers  cannot  agree 
on  "what"  potential  is  measuring.  The  potential,  as 
evaluated  on  the  OER,  should  be  defined,  criterion 
established  and  a measure  associated  with  each  block  on  the 
OER  form. 


PRIMARY  ZONE  FOR  PROMOTION:  The  factor  of  being 

in  the  primary  zone  for  promotion  made  the  most  significant 
increase  in  importance  under  the  new  system.  Data  show  that 
the  officers  in  the  primary  zone  for  the  first  time  are 
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receiving  a much  higher  percentage  of  top  ratings,  than 
that  prescribed  by  the  22-28-50  distribution.  Part  of  the 
explanation  may  be  that  officers  in  the  primary  zone  have 
attained  higher  positions  of  authority  and  responsibility 
from  which  to  demonstrate  potential. 

Another  possible  explanation  may  be  that  of  gaming. 

By  always  giving  the  senior  officers  in  a grade  the  top 
ratings,  no  one  is  hurt  and  everyone  is  taken  care  of  in 
the  long  run.  The  Air  Force  tends  to  discount  gaming 
based  on  the  fact  that  the  percentages  of  officers  in  the 
primary  zone  receiving  top  ratings  is  not  blatantly  out  of 
line  with  the  normal  22-28-50  distribution.  The  inflation 
of  the  old  system  was  caused  by  gaming.  Gaming  is  a 
natural  phenomenon,  in  that  it  is  an  attempt  to  beat  the 
system.  As  long  as  gaming  is  viewed  as  a way  of  beating 
the  system,  it  will  continue  to  survive.  As  more  officers 
become  aware  of  all  the  aspects  of  the  new  OER  system,  gaming 
will  become  more  prevalent.  The  author  cannot  recommend 
any  solution  to  gaming  because  whatever  the  system  is 
there  will  be  those  individuals  who  will  attempt  to  beat 
the  system. 


LENGTH  OF  TIME  IN  A JOB:  Under  the  old  system, 

in  order  not  to  penalize  the  new  man  on  the  job,  he  was 
given  a top  rating.  Because  of  the  forced  distribution 
under  the  new  system,  no  longer  can  anyone  practice  the 
policy  of  giving  a top  rating.  The  only  data  available  to 
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the  author  showed  that  the  officers  with  six  months  or 
less  on  base  were  receiving  a fair  proportion  of  top 
scores.  These  statistics  appear  to  be  distorted  by  certain 
factors.  Normally  an  officer  must  be  supervised  by  an 
individual  for  120  days  before  he  can  qualify  for  an  OER 
from  that  individual.  Therefore,  the  majority  of  officers 
with  six  months  or  less  on  base  with  a current  OER  would 
have  received  that  OER  from  their  previous  assignment.  At 
the  previous  assignment  the  officer  would  normally  have 
been  there  an  extended  period  of  time  before  being  trans- 
ferred. 

Nevertheless,  junior  officers  think  that  the  length 
of  time  in  a job  influences  the  rating  an  individual 
receives.  The  problem  lies  with  the  officer  who  due  to 
any  reasons  has  several  short  assignments.  Continually 
being  new  on  the  job  may  put  an  officer  at  an  unfair 
disadvantage.  Part  of  the  solution  may  come  from  relatively 
less  money  or  reasons  for  transfers,  thereby,  providing 
assignment  stability.  This  may  be  part  of  the  solution. 
Also,  a minimum  time  on  base  (perhaps  12  months)  should 
be  established  before  an  officer  can  receive  an  OER. 

RATER  AND  REVIEWER  QUALIFICATION : Approximately 

77  percent  of  the  officers  feel  the  rater  is  qualified  to 
recommend  who  should  receive  the  top  two  scores  while  only 
50  percent  feel  the  reviewer  is  qualified.  The  higher  the 
rating  an  individual  received  the  more  likely  he  felt  the 
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rater  or  reviewer  was  qualified.  Part  of  the  explanation 
may  be  that  human  nature  dictates  that  some  sort  of 
rationalization  or  blaming  occur  when  an  individual  does 
not  do  as  well  as  he  had  hoped.  As  long  as  raters  assign 
more  top  ratings  than  the  distribution  allows  the  only 
alternative  the  reviewer  has  is  to  downgrade  enough  OERs  to 
meet  the  distributions.  This  rater  inflation  and  reviewer 
downgrading  could  be  part  of  the  reason  officers  perceive 
the  evaluators  in  different  perspectives.  As  long  as  the 
inflation  and  downgrade  situation  exists,  the  credibility  and 
fairness  of  the  OER  system  is  judged  by  the  individual 
based  on  the  score  he  recieved.  The  rater  must  be  made 
aware  of  the  situation  he  is  causing  for  the  reviewer. 

DISTRIBUTION  FORCED  DOWNHILL:  The  point  at  issue 
dealing  with  the  distribution  being  forced  downhill  is  not 
whether  or  not  the  distribution  should  exist  at  the  lower 
levels  of  evaluations.  The  issue  is  the  fact  that  junior 
officers  perceive  that  the  distribation  is  being  forced 
upon  the  lower  level  evaluators.  The  rater  is  the  indivi- 
dual caught  in  the  middle.  The  rater  must  attempt  to  meet 
the  distribution  that  the  reviewer  is  required  to  meet  and 
at  the  same  time  evaluate  the  officers  whose  cooperation 
and  respect  he  needs  on  a daily  basis . In  doing  both 
these  tasks  the  rater  must  be  fair  and  objective. 
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Due  to  the  rater  knowing  the  ratees,  the  ratees  are  more 
likely  to  accept  his  judgement  than  that  of  an  officer  a 
couple  of  steps  up  the  chain  of  command.  The  rater, 
therefore,  tends  tc  inflate  his  ratings  in  order  to  maintain 
harmony  and  at  the  same  time  create  a problem  for  the 
reviewer.  In  reality  all  the  rater  does  is  establish  a 
maximum  score  the  ratee  can  obtain  from  the  reviewer. 

The  concern  of  the  ratee  is  that  the  rater  sets  the  tone 
of  the  OER  with  the  reviewer  actually  determining  the 
score  with  which  he  is  most  concerned. 

If  some  mechanism  can  be  devised  to  attach  more 
importance  to  the  rater  and  additional  rater  score, 
then  perhaps  the  inflation  can  be  cured.  For  example,  if 
some  sort  of  weight  based  on  the  number  of  ratings  and 
the  scores  a rater  assigns  can  be  attached  to  the  OER, 
then  maybe  inflation  can  be  stopped. 


PROMOTION  PROBABILITY:  Most  officers  feel  that 

if  an  individual  receives  a rating  in  either  of  the  top 
two  blocks,  his  chances  for  promotion  are  good.  Most 
officers  feel  that  if  an  individual  receives  a third 
block  rating,  his  chances  for  promotion  are  not  nearly 
as  good.  Telling  junior  officers  that  sixteen  percent 
of  the  first  time  eligible  majors  with  3'f  were  promoted 
is  not  going  to  make  junior  officers  believe  a 3 is 
promo table. 

Until  the  results  of  the  promotion  board  to  major 
are  in  and  explained,  junior  officers  are  going  to  perceive 
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CAREER  PROBABILITY : The  majority  of  officers 

feel  that  if  an  officer  primarily  receives  a 3,  he  will 
probably  not  achieve  a 20  year  Air  Force  career.  If 
this  perception  matches  Air  Force  desires,  then  there  is  no 
problem.  However  if  this  is  not  the  intention,  then  a 
problem  does  exist.  The  career  attainability  for  50% 
of  the  junior  officers  (those  with  a 3)  is  not  viewed 
with  high  hopes.  The  aspect  of  a 20  year  career  may  not 
be  the  main  motivating  factor  in  junior  officers,  but  it 
could  easily  become  a demotivating  influence. 

SUMMARY  AND  RECOMMENDATIONS : As  long  as  factors 

over  which  the  individual  has  no  control,  such  as,  being  in 
the  primary  zone  for  promotion,  length  of  time  in  a job, 
and  rater  and  reviewer  qualification,  are  perceived  to 
have  significant  influence  on  the  rating  an  individual 
receives,  there  will  be  some  dissatisfaction  and  demotivation. 
As  long  as  3*s  are  viewed  as  not  promotabie  and  unlikely 
to  achieve  a career,  then  demotivation  will  occur.  As 
long  as  an  undefined,  unsealed  and  criterionless  potential 
is  used  as  a measure  of  an  officer,  then  there  will  be 
some  who  are  upset.  Therefore,  the  author  recommends 
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that  potential  be  defined,  be  scaled  and  criterion 
established. 

With  the  future  implementation  of  Defense  Officer 
Personnel  Management  system,  any  problems  presently 
existing  in  the  new  OER  system  will  probably  increase  in 
magnitude.  If  the  professed  purpose  of  the  new  OER 
system  is  to  cure  inflation,  help  promotion  boards,  and 
let  the  individual  officer  know  where  he  stands,  then  the 
system  is  a success.  Should  there  exist  a purpose  other 
than  the  ones  listed  above,  then  maybe  this  unknown 
purpose  is  also  being  accomplished.  Regardless  of  the 
purpose,  the  system  does  have  some  problems.  The  ignoring 
or  denying  of  problems  in  a system  will  not  cause  them  to 
cease  to  exist.  The  problems  caused  by  the  imperfections 
of  the  new  system  are  minor  in  magnitude  at  this  time  and 
not  cause  for  alarm  or  concern.  However,  if  the  imper- 
fections continue  to  be  denied  or  ignored,  misconceptions 
and  rumors  will  increase  the  magnitude  of  the  problems 
out  of  proper  perspective.  The  people  and  agencies 
responsible  for  the  OER  system  should  review  and  analyze 
the  problems  and  issues  discussed  in  this  research  effort. 
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. STRONGEST  QUALIFICATION: 

. SUGGESTED  JOL‘  ASSIGNMENT  (Indicate  AFSC y. 

» organization  LEVEL  fS<?.  HU.  MAJCCM,  HQ  USAF.  Etc.)-. 
TIMING. 


<V.  EVALUATION  OF  POTENTIAL 


EVALUATE  THIS  OFFICER'S  POTENTIAL  FOR  INCREASED  GRADE  AND 
R ESP  ON  SI  Ol  LI  TY  IN  COMPARISON  WITH  CONTEMPORARIES,  INDICATE 
YOUR  RAT.NG  UY  PLACING  An  ••X*>  IN  THE  DESIGNATED  SECTION  OF 
APPROPRIATE  CLOCK, 


RA-FP- AOOM 
RA  , ER  RATER 


REVR  RATER  * RtVR 

RATER 


LOWEST  -<• 


VI.  HATER  COMMENTS 


ccmmlh  rs  ON  overall  evaluation 


AOON 

RATER 


■E  • 

,.AME,  GRAOC,  ORGANI  7.\  riON,  LOCATION 

DUTY  TITLE 

CATE 

1 

S3AN  (Include  Suftix) 

SIGNATURE 

VI!.  ADDITIONAL  RATES  COMMENTS  j| 

r 

COMMENTS  on  OVERALL  EVALUATION  Q3  CONCUR 

1 1 NONCONCUR  l 

! 

l 

* 

— 1 • i 

ws 


E 


THESIS  QUESTIONNAIRE 


Please  don't  throw  this  <FW*y !!!!!! 


The  following  questionnaire  is  a thesis  effort  by  one  of  your  fellow 
officers!  Please  take  the  time  to  fill  it  out. (How  would  you  feel  if  you? 
efforts  depended  on  someone  else  and  he  didn't  coins  through  for  you?) 


R 


Place  the  completed  form  in  v.  hex  marked 
located  iri  your  mail  room. 


'C;‘csticr:ii;  ire  Return  Pox" 


Than1,  you  for  your  cooperation. 


USAF  SCN  7T-06 
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PRIVACY  STATEMENT 

In  accordance  with  paragraph  30,  AFR  12-35,  the  following  information 
is  provided  as  required  by  the  Privacy  Act  of  1974: 

a.  Authority 

(1)  10  U.S.C.,  80-1.2,  Secretary  of  the  Air  Force,  Pov/ers  Duties, 
Delegation  by  Compensation;  and/or 

(2)  EO  93-97,  22  Nov  43,  Numbering  System  for  Federal  Accounts 
Relating  to  Individual  Persons;  and/or 

(3)  DOD  Instruction  1100.13,  17  Apr  68,  Surveys  of  Department 
of  Defense  Personnel;  and/or 

h.  Principal  purposes.  The  survey  is  being  conducted  to  collect 
information  to  be  used  in  research  aimed  at  illuminating  and  providing 
inputs  to  the  solution  of  problems  of  interest  to  the  Air  Force  and/or  DOD. 

c.  Routine  Uses.  The  survey  data  will  be  converted  to  information 
for  use  in  research  of  management  related  problems.  Results  of  the  research 
based  on  the  data  provided,  will  be  included  in  written  master's  theses  and 
may  also  be  included  in  published  articles,  reports,  or  te;;ts.  Distribution 
of  the  results  of  the  research,  based  on  the  survey  data,  whether  in 
v/ritten  form  or  presented  orally,  will  be  unlimited. 


d.  Participation  in  this  survey  is  entirely  voluntary. 


e.  Ho  adverse  action  of  any  kind  may  b?  taken  against  any  individual 
who  elects  not  to  participate  in  any  or  all  of  this  survey. 
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PLEASE  READ  THE  FOLLOWING  INSTRUCTIONS  BEFORE  ANSWERING 

THE  SURVEY 

To  facilitate  your  response  to  some  of  the  questions  in  the  questionnaire 
some  pertinent  facts  are  provided  below: 

1.  Under  the  OLD  OER  system  three  persons  could  normally  be  involved 
in  the  evaluation  process;  the  reporting  official,  the  endorsing  official, 
and  the  additional  endorser. 

2.  Under  the  NEW  OER  system  three  persons  will  normally  be  involved 
in  the  evaluation  process;  the  rating  official,  the  additional  rating 
official,  and  the  reviewing  official. 

3.  Under  the  OLD  OER  system  there  was  no  control  on  the  distribution 
of  scores. 

4.  Under  the  NEW  OER  system  the  reviewing  official  is  controlled  in 
his  distribution  of  scores. 


GENERAL  INSTRUCTIONS 


00  NOT  sign  the  survey  or  identify  yourself  in  any  way. 


Be  sure  that  your  marks  are  heavy  and  legible. 


USAF  SCN  7T-06 
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SECTION  I 


INSTRUCTIONS:  Please  circle  the  appropriate  letter  for  questions  1-11  and 
provide  the  numbers  requested  in  question  12. 


1.  What  is  your  present  active  duty  grade? 

A)  Lieutenant  B)  Captain 

2.  Which  one  of  the  following  do  you  consider  yourself? 

A)  Black  0)  Spanish  American  or  Mexican  American 

B)  American  Indian  E)  White(other  than  Spanish  or  Mexican  American) 

C)  Oriental  American  F)  Other 

3.  What  is  your  sex? 

A)  Male  B)  Female 

4.  What  is  your  highest  level  of  education  now? 

A)  Less  than  college  degree 

B)  College  degree(BS,  BA,  or  equivalent) 

C)  Graduate  work  beyond  bachelor  degree 

D)  Master's  degree 

E)  Postgraduate  work  beyond  master's  degree 

F)  Doctorate  degree 

5.  What  is  your  conmand  of  assignment(the  command  that  maintains  your 
personnel  records  prior  to  comlna  to  SOS)? 

A)  ADC  D)  ATC  G)  TAC  ■ 

B)  AFLC  E)  MAC  H)  AU 

C)  AFSC  F)  SAC  I)  Other 

6.  What  is  your  primary  aeronautical  rating? 

A)  Pilot  B)  Navigator  C)  Flight  Surgeon  D)  !!on-Rated 

7.  How  much  time  in  grade  do  you  have? 

A)  Less  than  1 year  l)j  4 yev.s  but  loss  tbvii  C 

B)  1 year  but  lass  than  2 E)  6 or  more  yours 

C)  2 years  but  less  than  4 

8.  What  is  your  source  of  Commission? 

A)  OTS  B)  ROTC  C)  AIR  FOPXC  ACADEMY  D)  Other 


9. 


Have  you  been  evaluated  under  the  NEW  Oivicer  Effectiveness  Report(OER)? 
A)  YES  D)  NO 


10.  It  ycu  have  been  evaluated  using  the  NEW  CER  please  circle  the  code  for 
the  scores  you  received. 


RATER 

A)  1 

B)  2 

C)  3 

D)  4 or  lower 


ADDITIONAL  RATER 

E)  1 

F)  2 

G)  3 

H)  4 or  lower 


REVIEWER 


I) 

J) 

K) 

L) 


1 

2 

3 

4 or  lower 
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11.  Which  of  the  fo-ilowing  best  describes  your  attitude  toward  making  the 
Air  Force  a career9 

A)  Definitely  intend  to  make  the  Air  Force  a career 
8)  Most  likely  will  make  the  Air  Force  a career 

C)  Undecided 

D)  Most  likely  will  not  make  the  Air  Force  a career 

E)  Definitely  do  not  intend  to  make  the  Air  Force  a career 

12.  What  are  the  first  TWO  digits  of  your  duty  Air  Force  Specialty  Code 
(AFSC)? 


SECTION  II 

INSTRUCTIONS:  Answer  the  questions  one  at  a time  and  independently  of  each 

other.  Each  question  has  two  parts  which  ask  for  your  perception 
of  the  OLD  OER  and  NEW  OER  systems.  Please  circle  the  number 
which  most  closely  corresponds  to  your  perception. 


13.  PHYSICAL  APPEARANCE  influences  the  rating  an  individual  receives. 


OLD  1 
NEW  I 
Strongly 
Disagree 


4 

4 ' 

Neutral/ 
No  Opinion 


Strongly 

Agree 


15.  An  UPCOMING  PCS  influences  the  rating  an  individual  receives 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 

3 4 

Neutral/ 
No  Opin!c;i 


Strongly 

Agree 


17.  LENGTH  OF  TIKE  IN  A JOB  influences  the  rating  an  individual  receives, 


OLD  1 
NEW  1 
Strongly 
Disagree 


4 5 

4 b 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 


19.  EDUCATIONAL  LEVEL  influences  the  rating  an  individual  receives, 


OLD  1 
NEW  1 
Strongly 
Di sagree 


3 4 5 

3 4 5 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 
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21.  SPECIAL  ASSIGNMENTS  influence  the  rating  an  individual  receives, 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 5 

3 4 5 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 


23.  SOURCE  OF  COMMISSION  influnces  the  rating  an  individual  receives. 


OLD  1 
NEW  1 
Strongly 
Disagree 


4 5 

4 5 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 


25.  ADDITIONAL  DUTIES  influence  the  rating  an  individual  receives. 


OLD  1 
NEW  1 
Strongly 
Disagree 


4 5 

4 5 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 


27.  PROFESSIONAL  MILITARY  EDUCATION (PME)  influences  the  rating  an  individual  receives, 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 5 

3-4  5 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 


29.  RATED  VERSUS  NON -RATED  influences  the  rating  an  individual  receives. 


OLD  1 
NEW  1 
Strongly 
Disagree 


Neutral / 
Mo  Opinion 


0 7 

G 7 

Strongly 
Agree 


31.  JOB  PERFORMANCE  influences  the  rating  an  individual  receives. 


OLD  1 
NEW  1 
Strongly 
Di sagree 


3 4 5 

3 4 5 

Neutral/ 

No  Opinion 


6 7 

G 7 

Strongly 
Agree 


33.  DIVERSITY  OF  PRIOR  ASSIGNMENTS  influences  the  rating  an  individual  receives. 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 5 

3 4 5 

Neutral/ 

No  Opinio.', 


6 7 

6 7 

Strongly 
Agree 
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35.  An  ESTABLISHED  DATE  OF  SEPERATION(DOS)  influences  the  rating  an  individual  receives, 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 5 

3 4 5 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 


37.  BEING  IN  THE  PRIMARY  ZONE  FOR  PROMOTION  influences  the  rating  an  individual  receives, 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 5 

3 4 5 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 


39.  A NON-JOB  RELATED  MISFORTUNE(i .e. .speeding  ticket)  influences  the  rating 
an  individual  receives. 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 5 

3 4 5 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 


41.  VISIBILITY (with  higher  level  rating  officials)  influences  the  rating  an 
individual  receives. 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 5 

3 4 5 

Neutral/ 

No  Opinion 


6 7 

6 7 

Strongly 
Agree 


43.  The  RULATJCNSHIP  BETWEEN  RATING  OFFICIALS  influences  the  rating  an 
individual  receives. 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 

3 4 

Neutral/ 
No  Opinion 


G 7 

G 7 

Strongly 
Agree 


45.  LEVEL  OF  ASSIGNMENT! i .e. .Squadron,  Wing,  MAJCO'i)  influences  the  rating 
an  individual  receives. 


OLD  1 
NEW  1 
Strongly 
Disagree 


3 4 

3 4 

Neutral/ 
No  Opinion 


6 7 

6 7 

Strongly 


47.  JOB  STATUS(i.e, . instructor  Pilot  versus  Line  Pilot)  influences  the 
rating  an  individual  receives. 


OLD  1 
NEW  1 
Strongly 
Disagree 


4 

4 

Neutral/ 
No  Opinion 


Strongly 

Agree 
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SECTION  III 


INSTRUCTIONS:  Use  the  following  list  of  18  factors  to  answer  the  question  below. 
Please  write  one  number  in  each  blank  provided. 


1)  Physical  Appearance 

2)  Upcoming  PCS 

3)  Length  of  Time  in  a Job 

4)  Educational  Level 

5)  Special  Assignments 

6)  Source  of  Commission 

7)  Additional  Duties 

8)  Professional  Military  Education 

9) Rated  Versus  Non-Rated 


10)  Job  Performance 

11)  Diversity  of  Prior  Assignments 

12)  Established  DOS 

13)  Primary  Zone  for  Promotion 

14)  Non-Job  Related  Misfortune 

15)  Visibility 

16)  Relationship  between  Rating  Officials 

17)  Level  of  Assignment 

18)  Job  Status 


48.  List  the  five  factors  you  consider  MOST  important  in  influencing  the  rating 
an  individual  receives.  (List  in  decreasing  importance) 


OLD  OER  SYSTEM  1 


NEW  OER  SYSTEM  1 


seen  on  iv 


INSTRUCTIONS:  The  following  questions  pertain  to  the  HEW  OER  SYSTEM  only. 

Please  circle  the  number  or  letter  that'most'c’icsoiy  cbvrei,pe:.r:c 
to  your  perception. 


£ ! 


49.  RATING  officials  are  generally  qualified  to  recommend  who  should  receive 
the  top  two  scores. 


Strongly 

Disagree 


4 5' 

Neutral/ 

No  Opinion 


6 7 

Strongly 
Agree 


50.  REVIEWING  officials  are  generally  qualified  to  recommend  who  should  receive 
the  top  tw(  scores. 


Strongly 

Disagree 


4 5 

Neutral/ 

No  Opinion 


6 7 

Strongly 
Agree 
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51.  The  distribution  of  scores  is  being  FORCED  downhill. 


1 2 

Strongly 
Disagree  ■ 


3 4 5 

Neutral/ 

No  Opinion 


6 7 

Strongly 
Agree 


52.  An  officer's  performance  when  he  receives  a_; 


Category  I rating  is 

A)  outstanding 

B)  above  average 

C)  average 

D)  belov/  average 

C)  marginal 

F)  not  evaluated 
6)  no  opinion 


Category  II  rating  is 

A)  outstanding 

B)  above  average 

C)  average 

D)  below  average 

E)  marginal 

F)  not  evaluated 
6)  no  opinion 


Category  III  rating  is 

A)  outstanding 

B)  above  average 

C)  average 

D)  below  average 

E)  marginal 

F)  not  evaluated 
6)  no  opinion 


53.  An  officer's  promotion  probability  to  the  next  higher  grade  if  he  receives 
Category  I rating  is  Category  II  rating  is  Category  III  rating  is 


A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 


A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 


A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  lew 

F)  no  opinion 


54.  The  ultimate  grade  an  officer  can  reach  if  ho  primarily  receives: 

Category  I ratings  is  Category  II  ratings  is  Category  UT  ratings  is 


A)  General 

B)  Colonel 

C)  LtColenel 

D)  Major 

E)  Captain 

F)  No  Opinion 


A)  General 

B)  Colonel 

C)  Lt Colonel 

D)  Major 

E)  Captain 

F)  No  Opinion 


A)  General 

B)  Colonel 

C)  LtColonel 

D)  Major 

E)  Captain 

F)  No  Opinion 


55.  An  officer's  probability  of  achieving  an  AF  career  of  20  years  if  ha 
primarily  receives: 


Category  I ratines  is  Category  II  ratings  is  Category  III  ratin--s  is 


A)  very  high 

B)  likely 

C)  net  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 


A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 


A)  very  high 

B)  likely 

C)  not  affected 

D)  unlikely 

E)  very  low 

F)  no  opinion 


l 
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